Personalized avatar responsive to user physical state and context

ABSTRACT

Systems and methods are disclosed that facilitate providing guidance to a user during performance of a program or routine using a personalized avatar. In an aspect, a system includes a reception component configured to receive physiological and movement information about a user during performance of a routine or program, and an analysis component configured to analyze the physiological and movement information based on reference physiological and movement metrics for the routine or the program to determine whether, how and to what degree the user deviates from requirements of the routine or the program. The system further includes a reaction component configured to determine a response for an avatar displayed to the user based on a determination regarding whether, how and to what degree the user deviates from the requirements of the routine or the program, and an avatar control component configured to initiate manifestation of the response by the avatar as displayed to the user.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. patent application Ser. No.15/208,455, filed Jul. 12, 2016, and entitled, “PERSONALIZED AVATARRESPONSIVE TO USER PHYSICAL STATE AND CONTEXT,” which is a continuationof U.S. patent application Ser. No. 14/593,603, filed Jan. 9, 2015 andentitled, “PERSONALIZED AVATAR RESPONSIVE TO USER PHYSICAL STATE ANDCONTEXT,” which is a continuation of U.S. Pat. No. 9,199,122, filed Oct.20, 2014 and entitled, “PERSONALIZED AVATAR RESPONSIVE TO USER PHYSICALSTATE AND CONTEXT,” which is a continuation in part of U.S. Pat. No.9,198,622, filed on Oct. 9, 2013 entitled “VIRTUAL AVATAR USINGBIOMETRIC FEEDBACK,” which claims priority to U.S. Provisional PatentApplication Ser. No. 61/711,510 filed on Oct. 9, 2012, entitled “VIRTUALAVATAR USING BIOMETRIC FEEDBACK” This application is also a continuationin part of U.S. Pat. No. 9,198,622, filed on Oct. 9, 2013 entitled“VIRTUAL AVATAR USING BIOMETRIC FEEDBACK,” which claims priority to U.S.Provisional Patent Application Ser. No. 61/711,510 filed on Oct. 9,2012, entitled “VIRTUAL AVATAR USING BIOMETRIC FEEDBACK The entiretiesof the aforementioned applications are incorporated by reference herein.

TECHNICAL FIELD

This application generally relates to systems and methods for generatinga personalized avatar that is responsive to a user's physical state andcontext.

BACKGROUND

The use of personal biometric monitoring equipment has increased theability of individuals to more easily and more accurately collect, trackand analyze data relating to the body's response to various triggers.For example, wearable sensors can monitor heart rate during an exerciseprogram and collect and record the heart rate data for further analysis.In addition, wearable movement sensors including fine tunedaccelerometers and gyroscopes combined with pattern analysis haveenabled the detection and analysis of user motion. The symbiosis of usermotion and biometric analysis facilitates an acute understanding of anindividual's physiological responses to various types of events andtriggers. As a result, various tools can be established that help tocontrol, improve or accommodate an individual's physical andphysiological activity.

BRIEF DESCRIPTION OF THE DRAWINGS

Numerous aspects, embodiments, objects and advantages of the presentinvention will be apparent upon consideration of the following detaileddescription, taken in conjunction with the accompanying drawings, inwhich like reference characters refer to like parts throughout, and inwhich:

FIG. 1 illustrates an example system architecture for manifestingresponses to physical and physiological activity information and imagedata about a user using a virtual avatar in accordance with variousaspects and embodiments described herein;

FIG. 2 provides an example avatar guidance system in accordance withvarious aspects and embodiments described herein;

FIG. 3 illustrates a flow diagram of a process for guiding or assistinga user with adhering to a program, routine or activity using an avatarin accordance with various aspects and embodiments described herein;

FIG. 4 illustrates an example fitness module for employment with anavatar guidance system in accordance with various aspects andembodiments described herein;

FIG. 5 illustrates an example user interface that facilitates receivinguser profile information in association with employment of an avatarguidance system for physical fitness purposes in accordance with variousaspects and embodiments described herein;

FIG. 6 presents an example user interface that facilitates designing acustom fitness routine in association with employment of an avatarguidance system for physical fitness purposes in accordance with variousaspects and embodiments described herein;

FIG. 7 presents an example user interface that presents a user with anavatar to facilitate guiding the user through a selected fitness routinein accordance with various aspects and embodiments described herein;

FIG. 8 illustrates another example fitness module for employment with anavatar guidance system in accordance with various aspects andembodiments described herein;

FIG. 9 illustrates an example program guide module for employment withan avatar guidance system in accordance with various aspects andembodiments described herein;

FIG. 10 presents a flow diagram of an example method for generating apersonalized avatar that is responsive to a user's physical state andcontext, in accordance with various aspects and embodiments describedherein;

FIG. 11 presents a flow diagram of another example method for generatinga personalized avatar that is responsive to a user's physical state andcontext, in accordance with various aspects and embodiments describedherein;

FIG. 12 presents a flow diagram of another example method for generatinga personalized avatar that is responsive to a user's physical state andcontext, in accordance with various aspects and embodiments describedherein;

FIG. 13 presents an example avatar visualization system that facilitatesvisualizing how the user will appear in response to adhering to a healthand fitness program in accordance with various aspects and embodimentsdescribed herein;

FIG. 14 presents another example avatar visualization system thatfacilitates visualizing how the user will appear in response to adheringto a health and fitness program in accordance with various aspects andembodiments described herein;

FIG. 15 presents a flow diagram of an example method that facilitatesvisualizing how the user will appear in response to adhering to a healthand fitness program in accordance with various aspects and embodimentsdescribed herein;

FIG. 16 presents a flow diagram of another example method thatfacilitates visualizing how the user will appear in response to adheringto a health and fitness program in accordance with various aspects andembodiments described herein;

FIG. 17 is a schematic block diagram illustrating a suitable operatingenvironment in accordance with various aspects and embodiments.

FIG. 18 is a schematic block diagram of a sample-computing environmentin accordance with various aspects and embodiments.

DETAILED DESCRIPTION I—Overview

The innovation is described with reference to the drawings, wherein likereference numerals are used to refer to like elements throughout. In thefollowing description, for purposes of explanation, numerous specificdetails are set forth in order to provide a thorough understanding ofthis innovation. It may be evident, however, that the innovation can bepracticed without these specific details. In other instances, well-knownstructures and components are shown in block diagram form in order tofacilitate describing the innovation.

By way of introduction, the subject matter described in this disclosurerelates to manifesting responses to physical and physiological activityinformation and image data about a user using a virtual avatar presentedto the user. In computing technology, an avatar is a graphicalrepresentation of a character or personality provided to conveyinformation to a viewer. An avatar can take a two or three-dimensionalhuman form and be configured to speak and move as would a real person.The disclosed subject matter relates generally to using an avatar whosebehavior and/or appearance changes based in part on received physicaland physiological activity information and image data about a user. Thephysical and physiological activity information can include sensedphysiological or biometric information about the user, motion dataregarding movement of the user and image data corresponding to two orthree dimensional image captures of the user. In an aspect, the physicaland physiological activity information is captured via one or morebiometric or motion sensors attached to the user. In another aspect, thephysical and physiological activity data is captured via an imagecapture device (e.g., a camera, a video camera, a three-dimensionalimage capture device, a three-dimensional scanner, etc.). In anotheraspect, the physical and physiological activity data is captured via aremote sensing device employed by the user (e.g., an external medicalmonitoring device, a handheld sensing device, a remote, a balance pad,fitness device employed by the user, etc.).

For example depending on the types of biometric sensors employed,collected physiological data about a user can include but is not limitedto: heart rate, body temperature, respiration, perspiration, bloodpressure, calories burned, body fat, and body weight. When biosensorsare employed, other physiological data based on chemical body reactionscan be determined, such as glucose levels, cortisol levels, bloodalcohol levels, presence of drug residues, presence of pathogens,presence of bacteria, etc. In addition, depending on the number andsophistication of motion sensors employed, collected movement data canrange from the detection of general movement pattern based motions suchas walking, running, sitting, jumping, climbing, etc., to even minutebodily motions such as strokes of a finger or the blinking of an eye.Further, image data can be captured of a user to facilitate generationon two or three-dimensional representations of the user.

In accordance with an embodiment, an avatar guidance system is providedthat analyzes received physical and physiological activity data about auser to evaluate adherence of the user to predefined routine or program.In response to analysis of received physical and physiological activitydata for a user, visual changes and/or verbal commands for manifestationby an avatar presented to the user are determined and effectuated. Inparticular, an avatar presented to the user is configured to exhibitvisual and/or audible behavioral reactions based on comparison ofmonitored data representing a metric of a user's physiology and/orphysical movement with respect to one or more reference metricsassociated with a routine or program the user has selected to follow.For example, in response to user physical and physiological activitydata falling outside a predefined range for a specific user behaviorassociated with performance of an action, task or routine, in order tocorrect the behavior of the user, the avatar can react in a way designedto reflect model techniques and behavior.

Visual and verbal avatar reactions can embody those which a real humanmay perform and can include but are not limited to changes in: motion ormovement, speech, tone of voice, level of sound/loudness, facialexpressions, body language, color, speed of movement, and range ofmotion. In an aspect, responses to user physical and physiologicalactivity data manifested by a virtual avatar as described herein aredetermined and effectuated in real-time (e.g., in response to receipt ofthe physical and physiological activity data). For example, a graphicaluser interface can be presented to the user that dynamically generatesthe avatar performing or exhibiting the determined responses. In anotheraspect, the avatar is rendered and presented to the user in the form ofa three dimensional hologram.

Existing systems, such as various gaming programs, have employed avatarsto mimic user motion data. For example, in response to a sensed jumpingmotion by a user, an avatar presented to the user may perform thejumping motion. However, rather than simply mimicking user motion, inaccordance with various aspect of the disclosed avatar guidance system,an avatar is configured to respond to a user based on evaluation of theuser's physical and physiological activity data with respect to apersonalized program developed for the user that the user strives tofollow. In particular, the avatar is configured to function as anintelligent being that has been specifically trained to observe, analyzeand respond to a user's physical and physiological activity data basedon a set of parameters defining at least one of: how the user should andshouldn't move, how the user's physiology should and shouldn't function,what actions or activities the user should and shouldn't perform, whenthe user should and shouldn't perform certain actions or activities, orhow the user should and shouldn't appear. This set of parameters can bespecifically tailored to govern user behavior with respect to apredetermined action, task or program.

For example, when performing a fitness routine that is associated withknown or model/reference movement and physiological parameters forperformance of the fitness routine by a model user, information can becollected about the user regarding the user's movement and physiology.The user's collected information is then compared to the known movementand physiological parameters to determine whether the user is adheringto the routine from an anatomical physical movement perspective and aphysiological perspective. In response to a determination that theuser's physical and physiological activity data deviates or does notdeviate from the known movement and physiological parameters, a responseis determined that is capable of being manifested by an avatar presentedto the user. This response can provide the user with guidance tofacilitate adherence to the fitness routine.

For instance, a response can include a determined physical action forthe user to perform to correct the deviation and this physical actioncan be demonstrated by the avatar. As one example, if a monitored useron a treadmill is slowing down when a routine followed by the user doesnot call for slowing down, an avatar configured to guide or coach theuser can change behavior to demonstrate a faster pace, therebyencouraging the user to speed up. The avatar can also provide verbalinstructions regarding performance of the physical action.

In another example, in response to a determination that the user'sphysical and physiological activity data deviates or does not deviatefrom the model or reference movement and physical parameters for thefitness routine, a response can be determined for manifestation by theavatar that provides criticism, motivation, praise, comparison, orfurther instruction. This response can encompass movement by the avatar,speech, facial expression, tone of voice, or any other real lifephysical human reaction that could be envisioned to facilitateexpression of criticism, motivation, praise, etc. In this way, as a userperforms a fitness routine, program, action or task, the user can feelas though a real person was observing the user in real-time andresponding in the form of personal intelligent coach that is an expertin evaluating and guiding performance of the specific routine, program,action or task.

In addition to comparison of received user physical and physiologicalactivity data to reference physical metrics for a specific routine,program, action or task, various aspects of the disclosed avatarguidance system provide for personalized analysis of user physical andphysiological activity data and personalized responses based on theanalysis for manifested by an avatar. In one aspect, the referencephysical and physiological activity metrics for the specific routine,program, action or task that is monitored for a user can be tailored orcalibrated to fit the user's personal physical capabilities, functionsand goals. For example, in furtherance to the physical fitness routineexample, metrics for a user's range of motion, motion speed, heart rate,blood pressure, etc., can be tailored and calibrated to fit the user'spersonal goals and account for the user's physical capabilities.

Further, responses to adherence or deviation from a routine, program,task or action (e.g., based on comparison to reference metrics orpersonally calibrated reference metrics) for manifestation by an avatarcan be tailored based on user preferences, demographics, mood, language,location, or context. For example, with respect to an avatar thatfunctions as a user's fitness trainer, an individual may providepreferences that note what type of exercises the user likes and doesn'tlike to perform or what type of coaching motivates the user (e.g., softencouraging technique over a more pushy demeaning approach). A responsedetermined for the avatar to perform can then be tailored to account forthe user's preferences. For instance, when the user is not achieving aparticular exercise included in the fitness routine, the avatar canprovide assurances that the user is “doing his best and that is all thatmatters,” as opposed to harping at the user and pushing the user “to getit right or get ten more minutes of abdominal work at the end of thesession.” In another example, an avatar that is configured to provideinstruction to a child can use different language and instructionaltechniques than an avatar configured to provide instruction to an adult.In yet another example, an avatar that is configured to provide guidanceto a user throughout the day to adhere to a diet plan can suggest foodoptions based on the user's context including the user's location,schedule and time of day.

Moreover, responses determined for manifestation by an avatar (based onreceived user physical and physiological activity data) to provide auser with guidance, instruction or support with respect to performing anaction, program, task or routine can be based on learned user behavior.For example, historical data regarding past reactions/responsesperformed by the user to avatar responses in association with same orsimilar routines, tasks or actions can be collected and analyzed usingvarious machine learning techniques to determine what types of avatarresponses work and don't work for the user. In another example, traits,habits and abilities of the user can be learned over time and employedto tailor avatar responses. For instance, when suggesting a new exerciseto transition to when a user is not achieving a previously suggestedexercise, the avatar can select an exercise that the user is known toperform well to boost the user's spirit. In another example, when a useris known to stop at a fast food restaurant on Elm street whenexperiencing high stress levels on the way home from work, an avatardesigned to help the user adhere to a diet program can warn the userthat the user is likely to perform this mistake and suggest an alternateroute and food option for the user.

The subject techniques for providing a user with guidance, instructionor support with respect to performing an action, program, task orroutine via a virtual avatar based in part on monitored user physicaland physiological activity data can have a variety of applications. Inone aspect, the disclosed techniques are tailored to facilitate guidinga user through a physical fitness routine or program, such as a personaltraining session, a physical therapy program or any other physicalactivity that may require an instructor, coach, teacher, therapist,trainer, etc. Some examples are ergonometrics, dancing, yoga, zumba, andmartial arts. For fitness applications, an avatar can play the role of avirtual instructor, coach, teacher, physical therapist, or personaltrainer. During performance of a fitness routine, a user's physiologicaland movement data is collected and compared to reference physical andphysiological activity metrics know for the specific fitness routine inview of personal information for the user (e.g., health restrictions,preferences, goals, etc.) to determine whether an avatar response iswarranted and if so, what the avatar response should be (e.g., aspecific verbal and/or visual command). After an avatar response isdetermined, the avatar displayed to the user performs the response.

In another aspect, the disclosed techniques can facilitate guiding auser with adherence to a diet program, a health program, a stressreduction program, a schedule and virtually any type of program that canbe monitored and adapted based at least in part on physiologicalcharacteristics/changes of the user and/or movement/motion of the user.Regardless of the application of the disclosed avatar guidance system,by employing a virtual avatar, instruction and information provided toguide or coach a user through a task or program is presented to the userby virtual human exhibiting real life human visual and audible responsesin the manner in which a personalized coach, therapist, assistant,friend, expert, doctor, etc. with particular insight about the userwould respond. Accordingly, the user will feel as though a real personwas by his or her side every step of the way throughout the program oractivity the user is striving to perform. In addition, this ‘realperson’ embodied via an avatar will be an expert at evaluating not onlyadherence to a specific program at hand, but a personalized guide thatknows just how to tailor evaluation of adherence to the specific programfor the user and how to tailor responses based on the evaluation tofacilitate the user's adherence to the specific program at hand.

In accordance with another embodiment, systems and techniques aredisclosed that provide for visualizing physical changes in a user basedon performance or predicted performance of a fitness or diet program. Inparticular, an avatar visualization system is provided that isconfigured to receive or generate a visual replica of a user as the usercurrently appears. This visual replica can be embodied as an avatarpresented to the user. As the user's appearance changes over the courseof performance of a health and fitness program, the appearance of theavatar can also change to provide a mirrored visualization of thechanges in the user. For example, each new day of the program, theappearance of the user can be evaluated, captured and imparted to theavatar. Thus in essence, the user's avatar can resemble a mirror imageof himself over the course of a program.

The avatar visualization system is further configured to generate avisual representation of the user that is a prediction of how the userwill appear at a future point in time based on performance of a healthand fitness program by the user. In particular, the avatar visualizationsystem can generate a visual representation or replica (e.g., an avatar)of a user based on currently received appearance information for theuser, currently received physical and physiological activity data forthe user (e.g., physiological data and/or movement data), and knownhealth information for the user (e.g., physical measurements, physicalconditions, physical capabilities, etc.). For example, the user canselect, (and/or design, or otherwise be assigned) a specific health andfitness program for performance. The user can further be provided with avisual representation that demonstrates how the user will predicativelylook after performance/completion of the program if the user adheres tothe requirements of the program. In addition, the user can selectvarious time points in the program (e.g., after week 1, after week 2,after week 3, etc.) and the avatar visualization system can generate avisual representation of the user that demonstrates how the user willpredicatively look at the respective time points if the user adheres tothe requirements of the program.

This avatar visualization system allows a user to dynamically pick andchoose different health and fitness programs and/or change differentvariables of a health and fitness program and see how the user wouldappear in the future based on the selected health and fitness programand/or the different variables. Accordingly, a user can select a healthand fitness program that will cause the user to achieve an optimallydesired appearance. For example, as the user selects different healthand fitness programs and/or can changes variables of a selected healthand fitness program, the avatar visualization system can dynamicallyadapt the appearance of an avatar presented to the user that correspondsto a predicted visualization of how the user will appear based oncompletion and adherence to the different health and fitness or thehealth and fitness program with the respectively chosen variables. As aresult, the user can select a specific health and fitness program basedon how it will affect the user's appearance.

II—System Architecture

Referring now to the drawings, with reference initially to FIG. 1,presented is a diagram of an example architecture 100 for systems thatfacilitates manifesting responses to physical and physiological activitydata about a user using a virtual avatar in accordance with variousaspects and embodiments described herein. System architecture 100 can beemployed in association with the disclosed avatar guidance system 200discussed in Section III and the disclosed avatar visualization systems1300 and 1400 discussed in section IV. Aspects of systems, apparatusesor processes explained in this disclosure can constitutemachine-executable components embodied within machine(s), e.g., embodiedin one or more computer readable mediums (or media) associated with oneor more machines. Such components, when executed by the one or moremachines, e.g., computer(s), computing device(s), virtual machine(s),etc. can cause the machine(s) to perform the operations described.

System 100 includes a person/user 102 and a client device 106 configuredto receive and/or capture physical and physiological activity data(e.g., physiological/biometric data, motion data, image data, etc.)about the user 102. In an aspect, one or more sensor devices 104 can beworn or otherwise attached to the user 102 to capture the physical andphysiological activity data and transmit the captured physical andphysiological activity data to client device 106 (e.g., in real-time orsubstantially real-time). For example, the one or more sensor devices104 can include biometric sensors configured to detect informationregarding at least one of: heart rate (e.g., via a heart monitordevice), body temperature (e.g., via a thermometer), respiration,perspiration, blood pressure, electrical activity of the heart or brain,calories burned, or body fat and body weight. In another example, theone or more sensor devices 104 can include biosensors configured todetect information regarding at least one of: glucose level, cortisollevel, blood oxygen level, blood alcohol level, inflammation, nitricoxide level, drug levels/residues present in the body, pathogens presentin the body, or bacteria present in the body. In an aspect, the one ormore sensor devices 104 can include implanted medical devices/sensorconfigured to detect and wirelessly communicate a wide array ofbiometric information about the user 102 to client device 106.

In addition to physiological/biometric data, sensor devices 104 canfacilitate capture and reporting of user movement or motioncorresponding to speed, direction, and orientation of the user a wholeand/or individual body parts of the user. For example, the one or moresensor devices 104 can include motion sensors such as an accelerometer,a gyroscope or an inertial measurement unit (IMU). Thus captured motiondata can include information identifying acceleration,rotation/orientation, and/or velocity of the motion sensor device 104itself, facilitating determination of motion and movement data of thebody and/or body parts to which the motion sensor are attached. Forexample, processing of raw motion data (e.g., by the sensor itself orthe device to which the raw motion data is communicated, such as clientdevice 106 and/or avatar server 116) can include pattern analysis todetermine or infer types of motion represented by the motion data and/orcharacteristics associated with the types of motion (e.g., intensity,duration, range, speed, etc.). For example, using pattern recognition,patterns in the motion data can be correlated to know patterns fordifferent types of motion, such as walking, running, climbing, jumping,falling, cycling, turning, etc. Motions sensors such as accelerometerscan also be used in detection for Parkinson's disease. Patients ofParkinson's disease are known to have involuntary shaking. For thosehaving mild symptom, shaking might not be significant. Since anaccelerometer is sensitive enough to detect even mild shaking, when itis placed on a patient's arm while he/she is intended to hold the arm instill, the accelerometer could report involuntary shaking.

In another aspect, physical and physiological activity data regardingmovements/motions performed by user 102 can include information capturedby an intelligent fitness device 119 employed by the user in associationwith performance of a fitness routine or exercise. For example, somefitness exercises can involve usage of fitness equipment, such asexercise machines (e.g., a treadmill, an bicycle, a rowing machine, aweight machine, a balance board, etc.) or accessories (e.g., freeweights, weighted balls, hula hoops, yoga blocks, bands, etc.). In anaspect, this fitness equipment can include a sensor device(s) configuredto track and record user movements and motions and report (e.g., viawireless or wired connections) these movements and motions to clientdevice 106 (and/or avatar server 116). For example, sensors andmonitoring devices included in a treadmill can track user speed andincline. In another example, sensors included in various weight machinesor free weights can detect and report number of reps, intensity, weightused, range of motion etc. Still in yet another example, a balance boardor pressure sensitive mat can detect user movement performed whilestanding on the matt based on pressure and weight distribution.

In yet another aspect, physical and physiological activity data about auser corresponding to movement/motion and appearance of the user 102 canbe captured by client device 106. For example, client device 106 caninclude a visual capture device 110 such as a still image camera, avideo camera, or a three dimensional camera/scanner configured tocapture image and/or video data of the user 102. According to thisexample, client device 106 can collect video and still images of theuser 102 as the user performs an activity, task, or routine (e.g., aworkout routine). The image data can be analyzed using patternrecognition to determine whether the user's movement corresponds tomodel movement metrics for the activity, task or routine. For instance,while performing a fitness routine such as a yoga or dance routine,image data captured by visual capture device 110 can be processed andanalyzed (e.g., in real-time) to determine whether the user is executingthe correct movements/poses and using proper form.

In another aspect, image data for a user captured by visual capturedevice 110 can be analyzed to determine physical measurements metricsfor the users, such as height, weight, body fat, dimension of the user'swaist, hips, shoulders, biceps, etc. As a user's body changes over time(e.g., in response to performance of an exercise or diet program),changes to physical measurement parameters of the user can be tracked,recorded, and monitored. In addition, a visual replica (e.g., a twodimensional image or three dimensional image where a three dimensionalimaging device is employed) of the user as the user actually appears(e.g., standing still or during performance of a fitness routine),should appear (e.g., based on a model) or may predicatively appear inresponse to advancement in a fitness/diet program, can also begenerated. In an aspect, an avatar that is generated and presented tothe user (e.g., via rendering component 108 and/or avatar platform 114)can be modeled to replicate the user's physical appearance based on thecaptured image data.

In another aspect, client device 106 can include a sensor module 112that can aid with detection of user motion and motion data usinginfrared or visible light detection devices. In yet another aspect,client device 106 can include a wearable device and sensor module 112can include biometric and/or motion sensors configured to capture thevarious physical and physiological activity metrics described withrespect to sensor devices 104.

Client device 106 also includes rendering component 108 to generate andpresent an avatar to the user 102. For example, rendering component 108can be configured to generate a graphical user interface that includesthe avatar and rendered via a display screen of the client device 106.In another example, rendering component 108 can be configured togenerate an avatar as a hologram that is presented to the user 102. Inan aspect, an avatar generated/presented via rendering component 108perform various visual and/or audible actions based at least in part onanalysis of the physical and physiological activity data as describedherein. In another aspect, an avatar generate/presented to the user viarendering component is configured to provide a visual replica of theuser.

In an aspect, client device 106 can include avatar platform 114 toprovide for processing and analyzing of user's physical andphysiological activity data to facilitate determination andmanifestation of avatar reactions and appearances to the data inaccordance with aspects described herein. In another aspect, some or allof the processing and analysis of the physical and physiologicalactivity data is performed by a remote avatar server 116. According tothis aspect, avatar server 116 can include an avatar platform 114 andclient device 106 can communicate received and/or captured physical andphysiological activity data to the avatar server 116 for processingthereof. The avatar server 116 can further communicate control commands,determined based on the processed physical and physiological activitydata, that control the various visual and/or audible actions of theavatar generated and displayed at client device 106 by renderingcomponent 108. In another aspect, various processing and analysisfunctions associated with avatar platform 114 can be divided betweenclient device 106 and avatar server 116. The various features andfunctions of avatar platform 114 are described in greater detail infrawith respect to FIGS. 2, 13 and 14.

System 100 can include one or more networks to facilitateconnection/communication between the one or more sensor devices 104,intelligent fitness device 118, client device 106, and/or avatar server114. These networks can include wired and wireless networks, includingbut not limited to, a personal area network (PAN), a local area network(LAN) a cellular network, or a wide area network (WAD, e.g., theInternet). For example, a sensor device 104 can communicate with clientdevice 106 using a PAN (e.g., via short range radio communications suchas Bluetooth™, near field communication (NFC), etc.). In anotherexample, a sensor device 104 and/or client device 106 can communicatewith avatar server 114 (and vice versa) using virtually any desiredwired or wireless technology, including, for example, cellular, WAN,wireless fidelity (Wi-Fi), Wi-Max, WLAN, and etc. In addition, the oneor more sensor devices 104, client device 106, and/or avatar server 114can include memory that stores computer executable components and aprocessor that executes the computer executable components stored in thememory, examples of which can be found with reference to FIG. 17.

Client device 106 can include any suitable computing device that canfacilitate generating and presenting an avatar to a user 102 that isreactive to user input including physical and physiological activitydata generated or provided by the user 102. For example, client device106 can include a desktop computer, a laptop computer, a television, anInternet enabled television, a mobile phone, a smartphone, a tabletpersonal computer (PC), a personal digital assistant PDA, or a wearabledevice. It should be appreciated that the size of client device 106 withrespect to user 102 as drawn in FIG. 1 is not intended to provide ascaled relationship between one another. For instance, in an aspect,client device 106 can include a small device configured to be worn onthe user's wrist, a device configured to be worn as a headband orglasses, or an 80 inch television. As used in this disclosure, the terms“content consumer” or “user” refer to a person, entity, system, orcombination thereof that employs system 100 (or additional systemsdescribed in this disclosure) using a client device 118.

III—Example Avatar Guidance System

In one or more aspects, an avatar guidance system is provided thatincludes a reception component a reception component configured toreceive physical and physiological activity information about a userduring performance of a routine or program, and an analysis componentconfigured to analyze the physical and physiological activityinformation based on reference physical and physiological activitymetrics for the routine or the program to determine whether, how and towhat degree the user deviates from requirements of the routine or theprogram. The system further includes a reaction component configured todetermine a response for an avatar displayed to the user based on adetermination regarding whether, how and to what degree the userdeviates from the requirements of the routine or the program, and anavatar control component configured to initiate manifestation of theresponse by the avatar as displayed to the user during the performanceof the routine or the program.

In another aspect, a method is disclosed that includes receivinginformation about a user during performance of a physical routine,wherein the physical information includes physiological information andanatomical movement information. The method further includes determiningwhether and how the user deviates from requirements of the physicalroutine based on comparison of the information to reference physical andphysiological activity metrics for the physical routine, and determininga response for an performance by avatar displayed to the user based onand in response to a determination regarding whether and how the userdeviates from the requirements of the physical routine, wherein theresponse is configured to facilitate adherence to the requirements ofthe physical routine. The method further includes initiatingmanifestation of the response, in response to the determination thereof,by the avatar as displayed to the user during the performance of thephysical routine.

Still in yet another aspect, a system is provided that includes aninterface component configured to generate a graphical user interfacecomprising an avatar configured to react to a user during performance ofa physical routine by the user in response to a determination that theuser deviates from a physical requirement of the routine based onanalysis of physical and physiological activity data about the usergenerated during performance of the physical routine. The system furtherincludes an avatar generation component configured to cause the avatarto perform a reaction that provides instruction to correct the manner inwhich the user deviates from the physical routine in response toreception of control commands defining the reaction, wherein thereaction comprises at least one of speech or movement; and a renderingcomponent configured display the graphical user interface with theavatar performing the reaction.

FIG. 2 presents an example avatar guidance system 200 that facilitatesguiding or assisting a user with adhering to a program, routine oractivity using an avatar in accordance with various aspects andembodiments described herein. System 200 can include same or similarfeatures and functionalities as system 100. In an aspect, system 200employs the architecture of system 100, including one or more of thevarious components/devices of system 100, wherein avatar guidanceplatform 202 corresponds to avatar platform 114. Avatar guidanceplatform 202 can thus include same or similar features andfunctionalities as avatar platform 114. Repetitive description of likeelements employed in respective embodiments of systems and interfacesdescribed herein are omitted for sake of brevity.

Avatar guidance system 200 can include avatar guidance platform 202,input 234, rendering component 236 and one or more remotesources/systems 238. Avatar guidance platform 202 is configured tofacilitate guiding or assisting a user with adhering to a program,routine or activity using an avatar that is responsive to various input234 associated with performance of the program, routine or activity.This input 234 can include physiological, motion and/or image data aboutthe user received (e.g., in real-time) during performance of theprogram, routine or activity.

For example, avatar guidance platform 202 can receive physical andphysiological activity data for a user during performance of a fitnessroutine and compare this physical and physiological activity data toreference physical and physiological activity data for the fitnessroutine to determine whether the physical and physiological activitydata deviates from the reference physical and physiological activitydata. In response to a determination that the user is moving too fast ortoo slow, has a heart rate to high or too low, is incorrectly orcorrectly performing a fitness movement, etc., avatar guidance platform202 can determine a response to manifest via an avatar to respond to thedeviation or non-deviation. For example, avatar guidance platform 202can determine an appropriate verbal command or remark for the avatar tospeak (e.g., “your heart rate is too low, lets speed it up”) and/or aphysical appearance/motion for the avatar to effectuate (e.g., theavatar can demonstrate the correct motion, the avatar can express anemotion of gratitude via a facial expressions and body movements, etc.).Avatar guidance platform 202 can then cause an avatar generated andpresented to the user via a GUI (or as a hologram) to carry out theresponse (e.g., speak the command, perform the motion and appearancechange, etc.).

In an aspect, the avatar is generated and presented to the user via arendering component 236 located at a client device (e.g., client device106). Rendering component 236 can include same or similar features andfunctionality as rendering component 108. Rendering component 236 caninclude suitable hardware (e.g., a display screen, a hologram generationdevice, etc.) and software (e.g., software for generating a GUI and/orsoftware for accessing and rendering network based interface, such abrowser) to accomplish generating and presenting an avatar that performsthe responses determined by avatar guidance platform 202 to facilitateguiding the user with adhering to the program, routine or activity beingmonitored.

Generally, avatar guidance platform 202 can include memory 218 thatstores computer executable components and processor 228 that executesthe computer executable components stored in the memory, examples ofwhich can be found with reference to FIG. 17. It is to be appreciatedthat although avatar guidance platform 202 is illustrated as being astandalone component, such implementation is not so limited. Forexample, avatar guidance platform 202 can be located at a client device(e.g., client device 106), a remote server (e.g., avatar server 116) orthe cloud. In another aspect, one or more components of avatar guidanceplatform 202 can be located at both the client device and the remoteserver. Still in yet another aspect, the components of avatar guidanceplatform can be distributed between the client and the server.

In addition to physical and physiological activity information and/orimage data about a user, input 234 can also include profile informationfor the user that defines various known characteristics of the user,including but not limited to, health information, preferences,demographics, user schedule, and historical information gathered aboutthe user over the course of a monitored program, routine or activity.This input can also include contextual information associatedperformance of the program, routine or activity, such as a location ofthe user, information about the location (e.g., a map of the location,physical structures at the location, events occurring at the location,etc.), weather information, information about other persons the user islocated near and/or interacting with, and other information provided bythe user during performance of the program, routine or activity (e.g.,information about the user's current mood or information about what theuser is currently thinking/feeling).

Avatar guidance platform 202 is configured to receive and process thesevarious inputs 234 about a user's physical state and activity along withvarious other personal and contextual information to facilitate guidingand assisting the user with performance of a specific program, routineor task via manifestation of responses based on the input to the userthrough an avatar. In particular, the avatar is configured to functionas an intelligent being that has been specifically trained to observe,analyze and respond to a user's physical and physiological activitydata, profile information and context information in association withperformance of a specific program, routine or task, based on variousrule based classification schemes for the program, routine, or task,defining at least one of but not limited to: what actions or activitiesthe user should and shouldn't perform, how the user should and shouldn'tmove during performance of the actions or activities, how the user'sphysiology should and shouldn't function during performance of theactions or activities, when the user should and shouldn't performcertain actions or activities, where the user should and shouldn'tperform certain actions or activities, or how the user should andshouldn't appear. In some aspects, avatar guidance platform 202 can evenmonitor interaction and association of the user with other people withrespect to performance of actions and activities of defined in aprogram, routine or task. For example, avatar guidance platform 202 canreceive information indicating the user is located within X feet of anidentified person and determine whether the user is authorized tointeract with the identified person (e.g., at all or under the currentcontext) based on a defined program the user is following.

Based on analysis of received input 234 with respect to a definedprogram, routine or task the user is performing, reactions aredetermined for manifestation by an avatar presented to the user. Thesereactions can include visual and/or audible (e.g., speech responses)responses that provide instruction, guidance, motivation, and evaluationfor the user with respect to the user's performance (or non-performance)of the program, routine or task. The visual and verbal avatar reactionscan embody those which a real human may perform to provide theinstruction, guidance, motivation, etc. and can include but are notlimited to changes in: motion or movement, speech, tone of voice, levelof sound/loudness, facial expressions, body language, color, speed ofmovement, and range of motion. In an aspect, possible reactions forperformance by an avatar in association with a specific program, routineor activity are predefined and stored in memory 218. In another aspect,reactions for performance by an avatar can be dynamically determinedbased on a set of response rules for the specific program, routine oractivity. These response rules can account for user physical andphysiological activity data as well as user profile information and usercontext information. In an aspect, avatar guidance platform 202 canemploy various machine based learning techniques to infer a suitablereaction for an avatar based on the various inputs and informationaccessible to avatar guidance platform 202.

In an aspect, a suitable routine or activity capable of being monitoredby avatar guidance platform 202 can involve one where a physicaltrainer, teacher or demonstrator could potentially provide the userassistance/guidance with performing the routine or activity. Forexample, the routine or activity can include a physical exercise orroutine where a coach or trainer may provide instruction and/orevaluation, such as performance of a physical therapy session, a plannedworkout, an aerobics routine, a dance routine, a yoga routine, track andfield training, or a sports activity (e.g., football, baseball, soccer,basketball, tennis, golf, fencing, gymnastics, skiing, karate, horsebackriding, juggling, rock climbing, diving, etc.). In another example, theroutine or activity can include any activity that involves some form ofphysical movement that could be demonstrated and evaluated by anotherperson, such as cooking a dish, building something, creating a piece ofartwork (e.g., painting, sculpting), performing a medical operation,playing an instrument, etc.

A suitable a program for evaluation by avatar guidance platform 202 caninclude one in which the user is required to perform various physical orphysiological actions over a period of time to achieve a goal. Theperiod of time can vary. For example, the period of time could include acourse of a few hours, a few days, a few weeks, a few months, etc. In anaspect, such a program could include a diet program, a fitness program,or a health program that involves monitoring and guiding a user withadherence to the program and tracking progress throughout the programbased in part on physical and physiological activity input data for theuser. For example, an avatar configured to guide a user through aprogram can function as the user's personal coach, trainer, conscience,doctor, therapist, advisor, friend, family member etc., or any othersuitable persona, that can function to guide or coach the user throughthe program. In an aspect, this avatar can essentially know what theuser is doing at all times with respect to the program (e.g., throughoutthe day, week, month, etc., or whenever system 200 is activated andaccessible to the user).

For example, with respect to a diet/fitness program, as user physicaland physiological activity input and/or image data is received, anavatar can respond to physical changes in the user, monitor what theuser eats or how many calories the user consumes/burns, instruct theuser what to eat and when, monitor when the user exercises, determineand instruct what exercises the user should perform, and assist the userwith making intelligent choices in line with the diet/exercise programthroughout the day. In another example, an avatar can function as ahealth guide for a user suffering from an illness or ailment,determining when the user should and shouldn't perform certainactivities, when the user should take certain medications, when the usershould seek emergency health services, when the user is becomingfatigued or sick, when the user's health is improving, etc., andresponding accordingly with visual and/or audible reactions. In anotherexample, an avatar can assist a user with overcoming an addiction, suchas a drug addiction or alcohol addiction, by monitoring the user'sphysical state and activity throughout the day and providing the userwith guidance and reactions in line with adhering to a rehab program.Still in yet another example, a user can set up a personal schedule thatcan involve activities the user should perform and when and avatarguidance platform 202 can monitor and facilitate adherence to theschedule.

Based on received inputs 234 for a user, (e.g., physiological data,motion data, image data, profile data, and/or context data)determinations and inferences can be made regarding adherence of theuser to the program, routine or activity and mechanisms to facilitateadherence of the program, routine or activity. These mechanisms can bemanifested by an avatar presented to the user at the time of need. Forexample, when a user is becoming unproductive at his work desk andfatigued based on input indicating the user's location, the user'smotion activity, the user's brain activity, the user's glucose levels,and the user's cortisol level, the avatar can notify the user andsuggest that the user get up and take a walk and eat a snack.

Reception component 204 is configured to receive input 234. Physical andphysiological activity input 234 about a user can be receivedautomatically from various sources including but not limited to: one ormore sensors attached to the user (e.g., sensors 104), an intelligentfitness device employed by the user (e.g., intelligent fitness device118), and/or an external device employed by the user, such as a visualcapture device (e.g., visual capture device 110), a sensor module (e.g.,sensor module 112), or other physical data capture devices. In anaspect, raw physical and physiological activity data and/or image datais received by reception component as it is captured. For example,sensors (e.g., sensors 104) worn by the user can send physical andphysiological activity data directed to reception component 204 inresponse to sensing thereby. Accordingly, physical and physiologicalactivity data about the user can be received and processed in real-timeor substantially real-time.

In addition to physical and physiological activity input captured byvarious external devices reception component 204 can receive some userprofile and context information from the user or another user associatedwith the user (e.g., the user's physical therapist, the user'sdietician, the user's mom, etc.) directly. For example, prior tobeginning a particular program, routine, or activity, the user or theother user can provide avatar guidance platform 202 (e.g., via text orspeech input) with profile information, such as information describingthe user's health history, the user's preferences, the user'sdemographics, etc. In another example, during performance of theprogram, routine or activity, the user can provide avatar guidanceplatform 202 with feedback and/or update his or her profile information.

In another aspect, reception component 204 can extract some forms ofinput or information regarding a user's profile and the user's contextfrom one or more remote sources 238 accessible to avatar guidanceplatform via a network (e.g., the Internet). For example, receptioncomponent 204 can access and import health information for the user fromthe user's health care provider. In another example, reception component204 can gather a variety of information about the user's preferences,demographics, social affiliations, media preferences, etc. from variousnetwork sources the user accesses or employs (e.g., social networkingsources, websites visited by the user, applications downloaded andemployed by the user, articles and media accessed by the user, etc.).

In addition, reception component 204 can receive information regarding auser's location using various known location determination techniques.For example, the user can wear a locating device (e.g., a locationtracking device, a global positioning system device, etc.) or a mobileclient device employed by the user can include systems for determining alocation of the mobile client. Location information can further bereported by these devices to reception component 204. Informationregarding positions of other known persons relative to the user can begathered in a similar manner (e.g., when such persons have authorizedand enabled tracking of their location). In an aspect, receptioncomponent can receive information related to a user's location and/orenvironment (e.g., physical structures, information about the physicalstructures, activities in the environment, weather information, etc.)from various remote sources and/systems accessible to receptioncomponent 204 (e.g., map services, new services, merchant websites,etc.).

Processing Module 210 is configured to process various input data 234received to facilitate guiding and assisting the user with performanceof a specific program, routine or task via manifestation of responsesbased on the input to the user through an avatar. Based on analysis ofreceived input 234 with respect to a defined program, routine or taskthe user is performing, processing module 210 determines or infersreactions for manifestation by an avatar presented to the user. In anaspect, processing module 204 process user physical and physiologicalactivity and context information as it is received and in view of userprofile information to determine real-time responses to user actions (ornon-actions) during a program, routine, or activity.

Processing module 210 includes can include analysis component 212,reaction component 214 and inference component 216. In an aspect,analysis component 212 is configured to analyze raw physical andphysiological activity data for a user to determine or infer featurevalues corresponding to what the raw physical and physiological activitydata represents. This analysis can occur in real-time or substantiallyreal-time (e.g., as the physical and physiological activity data isgenerated and received, such as by client device 106 and/or avatarserver 116). As described above, this raw physical and physiologicalactivity data can include biometric data, motion or movement data, andimage data. For example, biometric data could include informationcorresponding to a user's heart rate, blood pressure, blood oxygenlevel, temperature, glucose level, cortisol level, blood alcohol level,etc. In an aspect, received biometric data is received in a processedform to indicate the feature value it represents (e.g., heart rate,blood pressure, blood oxygen level, temperature, glucose level, cortisollevel, blood alcohol level, etc.). In some aspects however, analysiscomponent can interpret raw signals from various sensors to determinefeature values for biometric data.

Analysis component 212 can analyze raw motion data to determine a typeof movement performed (e.g., walking, squatting, jumping, etc.) by theuser and various characteristics of the movement, (e.g., range ofmotion, balance, weight/pressure, and even specific two or threedimensional coordinate positions of respective parts of the user's bodyas they move as a function of time). For example, based on the motiondata for the user as a whole and/or individual body parts of the user(e.g., corresponding to velocity, direction, orientation, position orpressure, etc.), analysis component 212 can determine a movement a useris performing including the precise position of the user's body partswith respect to one another and the ground or an apparatus over a periodof time. In another example, analysis component 212 can determinefeature values based on image data corresponding to the user'sappearance, including two and three dimensional measurements of theuser's body and individual parts (e.g., while moving over time or at astill position), color data, characteristics of facial expressions, etc.

In addition to processing of received raw motion data, analysiscomponent 212 can further determine a user's current context at a timeduring receipt (or non-receipt) of the physical and physiologicalactivity data. For example, based on received context information,analysis component 212 can determine a location of the user atrespective times throughout the day (e.g., using an internal clock).Analysis component 212 can further determine information about thelocation by parsing various remote sources/systems 238 that provideinformation related to the location and/or the current time. Forexample, analysis component 212 can extract a map of the location,determine what physical structures are at the location (e.g., houses,places of business, landmarks, etc.), information about the physicalstructures (e.g., hours of operation), events occurring at the location(e.g., traffic, sports match, etc.), current and prospected weatherconditions of the location, etc. Other context data that can be providedto analysis component 212 and/or determined by analysis component 212can include but is not limited to: information regarding other personsthe user is located near and/or interacting with, what mood the user isin, or what the user is currently thinking/feeling. The various featuresthat make up a user's context are referred to herein as contextparameters.

Accordingly, analysis component 212 can essentially determine at anypoint in real-time at which input 234 is received, feature valuescorresponding to at least one of: a physiological state of the user, amovement of the user or characteristic of the movement, an appearance ofthe user, and a context of the user. Therefore, analysis component 212can determine or infer what actions or activities the user isperforming, how the is moving during performance of the actions oractivities, how the user's physiology is functioning during performanceof the actions or activities, when the user is performing the actions oractivities, where the user is performing the actions or activities, howthe user appears when performing the actions or activities, who is nearthe user during performance of the actions or activities, and what theuser is thinking or feeling (e.g. based on information provided by theuser and/or various inferences based on the other information anddeterminations) during performance of the actions or activities.

After analysis component 212 has determined feature values and/orcontext parameters based on received physical and physiological activitydata and/or context data, respectively, analysis component 212 thenanalyzes adherence of the user's performance to a specific program,routine, or activity using these feature values and/or contextparameters. The specific program, routine or activity that avatarguidance platform 202 is monitoring can vary as discussed above. In anaspect, the program, routine, or activity that is monitored by avatarguidance platform 202 is selected by the user (or another entity) from alist of predefined programs, routines, or activities that avatarguidance platform 202 is configured to monitor. In another aspect,avatar guidance platform 202 can allow the user or another entity todesign a custom program, routine or activity for the user. In an aspect,custom programs, routines or activities can be saved and made availableto other users of avatar guidance platform 202 for selection andperformance.

For example, a user can select a specific activity or program (e.g., afitness routine, a sports activity, a diet program, a stress reductionprogram, etc.) to be monitored by avatar guidance platform 202 oranother user can elect the activity or program for the user (e.g., theuser's real life supervisor, doctor, coach etc.). For instance, the usercan select a yoga routine, a golf lesson, a diet program, or a stressmanagement program to follow and have monitored by avatar guidanceplatform 202. In another example, a user or supervisor of the user cancreate a custom program for a user that defines a schedule the usershould adhere to, what actions the user should and shouldn't do andwhen, what physiological status the user should have and when, etc. Inanother aspect, a user can employ avatar guidance platform 202 tomonitor several different programs, routines or activities for the userconcurrently. For example, the user can employ the avatar guidancesystem 200 to set up a personal training avatar to monitor an exerciseand fitness program for the user as well as a personal assistant avatarconfigured to monitor the user's adherence to a personal weekly scheduledesigned by the user.

In an aspect, based on known requirements for a program, routine oractivity being monitored, analysis component 212 can determine or inferwhether, how and to what degree the user is deviating from the program,routine or activity. For example, based on a user's physical andphysiological activity feature values and/or context parameters andknown requirements for these values/parameters for the particularprogram, routine or activity, analysis component 212 can determine orinfer information including but not limited to, whether, how and to whatdegree: the user's actions or activities deviate from the program,routine or activity; the user's movements deviate from the program,etc.; the user's physiological state deviates from the program, etc.;and the user's appearance deviates from the program, etc. In anotheraspect, based on known requirements for a program, routine or activity(and user profile information), analysis component 212 can determine orinfer whether, how and to what degree a user is likely to deviate fromthe requirements of a monitored program, routine or activity in theforeseeable future. For example, analysis component 212 can determine orinfer when one or more physical and physiological activity featurevalues and/or context parameters are near or approaching (e.g., within athreshold degree of deviation) a limit value for the physical andphysiological activity feature values and context metrics required bythe program, routine, or activity (e.g., when your blood pressure isclose to exceeding the limit, when your location is near a forbiddenlocation and you are moving in the direction to the forbidden location,etc.).

In an aspect, known requirements for a specific program, routine, oractivity can include predetermined reference metrics for the specificprogram, routine or activity defining values or value ranges for thewhat the user's physical and physiological activity feature valuesand/or context parameters should be. In an aspect, these referencemetrics 220 are stored in memory 218. These reference metrics can beapplied to various algorithms and classification schemes that relate thereference metrics to determined feature values and/or context parameterswith respect adherence to of the user to a specific program, routine, oractivity. Accordingly, analysis of physical and physiological activityfeature values and/or context parameters with respect to referencemetrics can involve various ruled based classification schemes whereinthe feature values are analyzed based in part on the reference metricsfor the program, routine or activity to determine whether the user'sphysical and physiological activity feature values and/or contextparameters indicate the user is deviating from and/or likely to deviatefrom, the program, routine, or activity, how the user is deviatingand/or is likely to deviate, and or to what degree the user is deviatingand/or likely to deviate, (wherein likely can be measured in terms ofprobability).

In an aspect, evaluation of adherence to a specific program, routine ortask includes a simple comparison of physical and physiological activityfeature values and/or context parameters to known reference metrics forthe specific program, routine or activity. In another aspect, the set ofpredefined reference metrics for a program, routine, or activity caninclude model/reference value ranges for the physical and physiologicalactivity feature values and/or the context parameters. According tothis, aspect, adherence and/or non-adherence to an aspect of an program,routine or activity can be based on deviation outside of a thresholdrange. A set of reference metrics for a program, routine, or activitycan also include model/reference values or model/reference value rangesfor different combinations of physical and physiological activityfeature values and/or context parameters.

For example, based on a comparison of a physical and physiologicalactivity feature value or set of physical and physiological activityfeature values to a reference physical and physiological activityfeature value or set of reference physical and physiological activityfeature values, analysis component 212 can determine, whether the user'sblood pressure is too high or too low, whether the user's body positionis correct, whether the user's performing an exercise correctly with theproper intensity and form. In an another example, based on such acomparison, analysis component 212 can determine, whether the user'sstress levels are appropriate, whether the user's blood sugar is high orlow, whether the user has consumed enough calories, whether the user hasburned enough calories, or whether the user lost the desired amount ofweight or inches of her waist, etc.

In another example, with respect to a fitness routine, reference metricscan define what the user's body movement and position should correspondto over the course of the fitness routine as well as what the user'sheart rate should be with respect to each movement. In another example,with respect to stress reduction program, reference metrics can definewhat the user's heart rate, cortisol level, glucose levels, and activitylevels and sleep patterns should correspond to throughout the day, whenat various locations, when interacting with certain people, and/or withrespect to certain activities, (e.g., working, driving, operating acertain machine, reading a book, going for a walk, etc.).

In another example related to analysis of physical and physiologicalactivity feature values, based on comparison of biometric data for auser indicating a user's heart rate is 180 beats per minute (bpm) toreference metric data that defines the target heart rate for theexercise to be 150 bpm, analysis at step 210 can output a determinationthat the user's heart rate is too high, specifically 30 bmp too high. Inyet another example, based on comparison of motion data indicating auser's motion pattern corresponds to X when is should correspond to Y,analysis at step 210 can output a determination that the user's motionis incorrect and even more specifically how the motion is incorrect(e.g., the user's legs should be bent another 10°).

In addition to physical and physiological activity feature basedreference metrics, programs, routines and be associated with contextreference parameters that define requirements such as location, time ofday, environmental characteristics, user mood, and other people withinproximity to or interacting with the user. For example, a particularmonitored activity or program, such as program designed to restrict anadolescent's social behavior (e.g., by the adolescent's parents), can beassociated with various predetermined metrics and rule basedclassification schemes regarding what the adolescent should be doing,when the adolescent should be doing it, where the adolescent should belocated, and/or who the adolescent should or shouldn't be with.Accordingly, received contextual information regarding where a user islocated and when, combined with external accessible information aboutthe user's environment (e.g., physical structures, events, etc.) andreceived physical and physiological activity data for the user (e.g.,movement patterns, the user's stress levels, the user's activity levels,user fatigue levels), can facilitate determining or inferring adherenceto the activity or program.

For example, based on a user's location and time of day determinationscan be made regarding the physical environment of the user, such as theterrain, what places of business are around, and what events areoccurring at the location, (e.g., a football game). Depending on theuser activity or program being monitored, this information canfacilitate determinations regarding adherence to the activity orprogram. For example, an alcohol addiction recover program can includecontext metrics that define triggering locations for the user atspecific, such as areas within X meters from a bar between the hours of5 pm and 7 pm. According to this example, analysis component candetermine or infer that the user is deviating from the program or islikely (e.g., has a determined probability of deviated over a thresholdprobability) when headed into an area with a bar a at happy hour time.

It should be appreciated that the above example comparison basedevaluations of physical and physiological activity feature values and/orcontext parameters to reference metrics are merely exemplary. Inparticular, a variety of more complex rule based classification schemescan be defined that relate a plurality of concurrently received orapplicable physical and physiological activity feature values and/orcontext parameters to one another and their respective reference valuesfor the particular activity or program to determine whether, how, and towhat degree, a user is deviating from a program, routine or activity.

In addition to comparison of determined physical and physiologicalactivity feature values and/or context parameters to the referencemetrics for the program, routine or activity, analysis component 212 canemploy user profile data 222 to personalize evaluation of the user'sperformance and adherence to the program, routine or activity. As aresult, the various aspects and applications of avatar guidance platform202 can be highly personalized.

For example, in one an aspect, the set of predefined reference metricsfor a specific program, routine, or activity can generically suited fora model user. In another aspect, the reference metrics can be providedor adapted by the user performing the activity or program or asupervisor of the user (e.g., an entity or person who instructed theuser to perform the activity or program using the subject avatarresponse system 114, such as the user's coach, health advisor, rehabprogram administrator, mother, etc.). Still in yet another aspect,analysis component 212 can adjust or calibrate evaluation (e.g., usingrule based classification schemes and other intrinsic calculations) ofphysical and physiological activity feature values and/or contextparameters using respective reference metrics for the program, routineor activity, based on user profile data.

User profile information can include but is not limited to, healthinformation, user preferences, user demographics, user schedule andhistorical information about the user's behavior in association withperformance of various activities and programs monitored by the avatarresponse system 114. Health information can include any informationrelated to the user's health and physical state, including knownphysical metrics for the user (e.g., height, weight, body fat, etc.),physical conditions or ailments of the user, physical capabilities ofthe user, and any medications taken by the user. User preferenceinformation can vary depending on the application of the avatar guidanceplatform 202 for the user. Some examples of user preference informationcan include features and aspects of a fitness, health or other type ofan activity or program that the user prefers/likes and/or does notprefer (e.g., foods the users likes/dislikes, dietary restrictions,places the user likes to go/not go, exercises the user likes/dislikes toperform, when the user liked to perform or not perform variousactivities, etc.). In another example, preference information can relateto what types of character traits that the user desires in an avatardesigned to respond to, coach or instruct the user. Still in yet anotherexample, user preference information can include information defininggoals of the user (e.g., fitness goals, weight loss/weight gain goals,what the user desires to look like, milestones in a recovery program,and targets for performance of various other activities).

User demographic information can define various demographic features ofthe user, including but not limited to: gender, age, nationality,language, education level, or profession. User schedule information canprovide information regarding what the user should and shouldn't bedoing and when based on the user's work, extracurricular activities andpersonal relationships and responsibilities. For example, user scheduleinformation can be provided to determine when a user should be at workand where, what meetings the user has, when the user has set up eventsor social activities, when the user has vacations scheduled, doctorsappointment scheduled, physical therapy or fitness session scheduled,etc. In an aspect, user schedule information can be extracted from apersonal calendar of the user (e.g., from an application employed by theuser on the user's client device 106 and/or at remote source/system238).

Profile information can be received from various sources. In an aspectprofile information can be provided by the user in association withregistration with avatar response system 114, provided by another entityor source (e.g., medical professional, coach, fitness trainer,therapist, rehab program director), automatically imported by the avatarresponse system from various external sources (e.g., heath records, theuser's calendar, social networking profiles, etc.), and/or automaticallyinferred or determined by the avatar response system.

In an aspect, analysis component 212 can employ user profile informationto facilitate determining or inferring a probability at which a user islikely to deviate from a monitored program, routine or activity withinthe near future (e.g., within the next 10 seconds, within the nextminute, within the next 10 minutes, within the next 30 minutes, withinthe next hour, etc.) based on physical and physiological activityfeatures values and/or context metrics received/determined for the user.For example, analysis component 212 can analyze user patterns withrespect to past deviations for program requirements similar to a currentprogram requirement to determine the probability that the user willdeviate from the current program requirement when physical andphysiological activity feature values and/or context parameters for theuser are x, y, and z, (where x, y and z correspond to variable values).In another example, analysis component 212 can analyze user preferences(e.g., what the user prefers to eat/drink, where the user prefers to go,what the user prefers to do, who the user prefers to associated with,etc.), to determine or infer how a degree of likelihood that the userwill deviate from requirements of a monitored program given knowninformation for the user's physical state (e.g., appearance,physiology), the user's body movement/position, and the user's context.

Reaction component 214 is configured to determine or infer a reaction(or non-reaction) for manifestation by an avatar presented to the userbased on a determination by analysis component 212 identifying whether,how and to what degree a user is violating or is likely to violate amonitored program, routine or activity. The reaction is designed to keepthe user's behavior and/or performance in line with the monitoredprogram, routine or activity. For example, when a deviation isdetermined, reaction component 214 can determine a reaction formanifestation via an avatar that will instruct the user how to correctthe deviation and/or encourage the user to correct the deviation orimprove upon the deviation (e.g., where the deviation reflects positivebehavior). In another example, when analysis component 212 determinesthat a user is complying with a program, routine, or activity, reactioncomponent 214 can determine a reaction for manifestation via an avatarthat provides praise to the user. In another example, when analysiscomponent 212 determines that a user is likely to deviate from aprogram, routine or activity, reactions component 214 can determine areaction for manifestation by an avatar that is designed to deter orprevent the user from deviated from the program, routine or activity.

In an aspect, a reaction determined by reaction component 214 formanifestation by an avatar can involve visual or spoken instruction bythe avatar providing a mechanism to correct a deviation to a program,routine, or activity, an action taken by the avatar to deter or preventthe user from deviating from the program, etc., a tactic to motivate theuser to adhere to the program, etc., a tactic to praise the user foradhering to the program, etc., or a tactic to criticize the user for notadhering to the program, etc. These reactions can involve visual andverbal actions which a real human may perform and can include but arenot limited to changes in: motion or movement, speech, tone of voice,level of sound/loudness, facial expressions, body language, color, speedof movement, and range of motion. For example, the avatar can speak tothe user and demonstrate body movement and facial expressions that areal human would in order to convey a reaction. In another aspect, anavatar reaction can include sending an electronic message (e.g., email,text message, etc.), or initiating a phone call to another entity viathe client device (e.g., client device 106) employed to render theavatar.

For example, based on a determination by analysis component 212 that auser's heart rate is too high while performing a fitness routine,reaction component 214 can determine a response for manifestation by theavatar to direct the user to slow down. For example, the determinedreaction to be manifested by the avatar can include a verbal spokencommand to “slow down the pace” as well as a physical demonstration bythe avatar of the exercise at the correct pace. In another example, inresponse to a determination by analysis component 212 that a userparticipating in an alcohol addiction recovery program has a bloodalcohol level of X and/or is located at or near a bar, a response can bedetermined by reaction component 214 for manifestation by an avatar thatincludes verbal instruction criticizing the user for the bad behaviorwith corresponding facial expression and body language that showing anexpression of disappointment. In addition, reaction component 212 caninitiate calling of the user's alcohol anonymous (AA) sponsor and theavatar presented to the user can inform the user that a phone call isbeing initiated. In another example, in response to a determination thata user is likely to deviate from a diet program based on informationindicating the user is stressed, the user is hungry, and the user isnear another person that the user usually makes deviating food choiceswith on Monday afternoons (when the time is Monday 3 pm), reactioncomponent 214 can determine a reaction for manifestation by an avatarthat calls the user's attention to the scenario, and provides the userwith breathing exercises to perform with the avatar as a guide to reducethe user's stress before the user's makes any poor decisions.

In another aspect, an avatar reaction can include provision of externaldata to the user at the client device (e.g., client device 106) employedto render the avatar. The external data can include but is not limitedto: documents, articles, media, multimedia (e.g., video, animations,sounds, music, etc.), or hyperlinks to these data objects, that areaccessible to avatar guidance platform (e.g., in memory 212, or at aremote source/system 238). For example, in association with an avatarreaction to facilitate encouraging a user to stick to an anti-smokingprogram, the avatar can provide the user with an article about theeffects of smoking. In another example, to encourage a user to adhere toa fitness program, the avatar can provide a user with an image ofherself when she used to weight 251 bs more and an image of what shewill look like at her goal weight.

In another example, in response to a determination by analysis component212 that a user on a diet program is becoming stressed (e.g., based oncortisol levels) and has taken a walk to the vending machine (e.g.,based on location and movement data), reaction component 214 candetermine or infer a reaction for manifestation by an avatar that detersthe user from making bad food choices. For example, reaction component214 can determine a response that includes providing the user withmotivation to stick to the diet program by playing a video of the user'spast fitness dedication. The avatar can further speak to the user toencourage the user not to select the candy bar from the vending machineand rather go to the cafeteria to get a banana (e.g., a preferred snackoption determined based on the user's food preferences and dietaryrestrictions).

In an aspect, reaction component 214 can determine or infer what actionor inaction the user should do to correct an identified deviation andthen determine or infer a proper reaction for manifestation by theavatar to direct the user to perform the action. For example, inresponse to a determination by analysis component 212 that a user hasnot mastered a particular golf swing (e.g., based on a determinationthat the user's physical motion indicates improper performance of thegolf swing), reaction component 214 can determine that the user shouldswitch to practicing a different swing and associated club. Thusreaction component 214 can determine a response for manifestation by anavatar that includes verbal instruction telling the user to switch tothe other club along with physical simulation of the new golf swing withthe new club.

The particular response determined by reaction component 214 formanifestation by an avatar can be based on a plurality of factors andinformation. In an aspect, known deviations, deviation types and degreesof the deviations for a specific program, routine or activity can bedefined and correlated to fixed avatar reactions. For example, for afitness routine, if blood pressure is too high, the associated avatarresponse can include a slowing down movement. In addition, reactioncomponent 214 analyze user profile information to tailor response to theparticular user, (e.g., based on user preferences, user demographics,user health information, user behavioral history, etc.). Further,reaction component 214 can consider context information when determininga reaction for manifestation via an avatar to counterbalance a deviation(or adherence) to a program, routine or activity. For example, whenreaction component 214 determines that a user should perform an actionto reduce stress (e.g., based on a determination that the user's stresslevel is too high in association with a stress reduction program),reaction component 214 can determine the action based on the user'slocation, weather conditions, time of day, etc. For instance when it israining, the action can include performing yoga indoors, yet when it isnot raining, the action can include taking a walk outside.

In an aspect, reaction component 214 can employ various defined responserules 224 that relate known deviations and degrees of the deviations fora specific program, routine or activity, with user profile informationand context information to a plurality of possible pre-defined avatarreactions. For example, the response rules 224 can include a set ofprefixed avatar responses that are mapped to potential determinations ofdeterrence and/or adherence to a particular activity or program. Theseprefixed responses are specific to the program, routine, or activitybeing monitored. In an aspect, prefixed responses are defined by anadministrator that created the activity or program guidelines.

In other aspects, reaction component 214 can modify/adapt prefixedavatar reactions and/or develop new avatar reactions based on thespecific program, routine or activity, the determined deviation (oradherence), user profile information (e.g., user preferences, historicaluser behavior, user health information, etc.), user context information,and known capabilities of the avatar, using various classification(explicitly and/or implicitly trained) schemes and/or systems (e.g.,rule based classification schemes, support vector machines, neuralnetworks, expert systems, Bayesian belief networks, fuzzy logic, datafusion engines, etc.).

Processing module 210 can include inference component 216 to provide foror aid in various inferences or determinations associated with aspectsof avatar guidance platform 202. In an aspect, all or portions of avatarguidance platform 202 can be operatively coupled to inference component216. Moreover, inference component 216 can be granted access to all orportions of media provider, remote sources/systems 238, client device106 and other sources accessible via a network 112.

In an aspect, analysis component 212 can employ inference component 216to infer whether, how and to what degree a user deviates from a specificprogram, routine or activity. In association with such inferences,inference component 216 can examine determined physical andphysiological activity feature values and reference physical andphysiological activity feature values, determined context parameters andreference context parameters, user profile information, and othercontext information. In addition, reaction component 212 can employinference component 216 to infer a response for manifestation via anavatar that facilitates adherence to a program, routine or activity.Reaction component 214 can also employ inference component 216 to inferan action a user should perform to correct a deviation from a program,routine or activity as well as a reaction for manifestation via anavatar the directs and/or motivates the user to perform the action. Inassociation with such inferences, inference component 216 can examinedeviations that have been determined/inferred by analysis component 212,information relating such deviations to predetermined avatar responses,user profile information, and user context information.

In another aspect, analysis component 212 can employ inference component216 to infer foreseeable violations/deviations to a program, routine, oractivity which the user is following. For example, where a user onalcohol addiction recover program is headed into an area with severaltriggers for the user (e.g., bars at happy hour time) and the user hashigh cortisol levels, inference component 216 can infer that the user islikely to be inclined to fall off his program and stop at a bar. Basedon inferences identifying foreseeable violation/deviations, reactioncomponent 214 can employ inference component 216 to infer mechanisms tocircumvent the occurrence of the foreseeable violations/deviations andinfer reactions for manifestation via an avatar to facilitate relayingthese mechanisms to the user. In furtherance to the subject example,reaction component 214 can infer that a call to the user's AA sponsorand warning message would help deter the user from violating hisprogram. Thus reaction component 214 can initiate a response formanifestation by the avatar that includes a call to the AA sponsor and amessage delivered with a suitable tone of voice and facial expressionwarning the user not to violate his program.

In order to provide for or aid in the numerous inferences describedherein, inference component 216 can examine the entirety or a subset ofthe data to which it is granted access and can provide for reasoningabout or infer states of the system, environment, etc. from a set ofobservations as captured via events and/or data. An inference can beemployed to identify a specific context or action, or can generate aprobability distribution over states, for example. The inference can beprobabilistic—that is, the computation of a probability distributionover states of interest based on a consideration of data and events. Aninference can also refer to techniques employed for composinghigher-level events from a set of events and/or data.

Such an inference can result in the construction of new events oractions from a set of observed events and/or stored event data, whetheror not the events are correlated in close temporal proximity, andwhether the events and data come from one or several event and datasources. Various classification (explicitly and/or implicitly trained)schemes and/or systems (e.g., support vector machines, neural networks,expert systems, Bayesian belief networks, fuzzy logic, data fusionengines, etc.) can be employed in connection with performing automaticand/or inferred action in connection with the claimed subject matter.

A classifier can map an input attribute vector, x=(x1, x2, x3, x4, xn),to a confidence that the input belongs to a class, such as byf(x)=confidence(class). Such classification can employ a probabilisticand/or statistical-based analysis (e.g., factoring into the analysisutilities and costs) to prognose or infer an action that a user desiresto be automatically performed. A support vector machine (SVM) is anexample of a classifier that can be employed. The SVM operates byfinding a hyper-surface in the space of possible inputs, where thehyper-surface attempts to split the triggering criteria from thenon-triggering events. Intuitively, this makes the classificationcorrect for testing data that is near, but not identical to trainingdata. Other directed and undirected model classification approachesinclude, e.g., naïve Bayes, Bayesian networks, decision trees, neuralnetworks, fuzzy logic models, and probabilistic classification modelsproviding different patterns of independence can be employed.Classification as used herein also is inclusive of statisticalregression that is utilized to develop models of priority.

Avatar guidance platform 202 can further include interface component206, avatar control component 208 and avatar generation component 226.Interface component 206 configures a graphical user interface(s) thatfacilitates user interaction with system 200. In particular, interfacecomponent is configured to generate a graphical user interface thatincludes an avatar that performs the various reactions discussed herein.The graphical user interface is presented to the user via renderingcomponent 236 located at a client device (e.g., client device 106)employed by the user. In some aspects, the interface can providemechanisms to select or create a program, routine or activity that auser would like to perform and have monitored via avatar guidanceplatform 202. The interface can further provide mechanisms for receivinginput from a user related to a profile of the user and allowing the userto access and view his or her profile information. Some exemplaryinterfaces configured by interface component 206 in association withapplication of avatar guidance platform 202 to facilitate guiding a userthough a fitness routine or activity are presented in FIGS. 5-7.

Avatar control component 208 is configured to interpret a response orreaction determined by reaction component 214 for manifestation by anavatar presented to a user and determine control commands to provide toavatar generation component 226 to effectuate the response by theavatar. Avatar generation component 226 is configured to generate anavatar that performs the response/reaction based on the controlcommands. In particular, avatar generation component 226 is configuredapply the control commands to an avatar displayed to a user and generatean avatar performing the response/reaction. In essence, avatargeneration component 226 is configured to generate an animation with anavatar moving, speaking, and/or appearing based on control commandsreceived from avatar control component 208.

As previously described, in an aspect, avatar guidance platform 202 islocated at the client device (e.g., client device 106) that includesrendering component 236. In another aspect, one or more components ofavatar guidance platform 202 are located at a remote server (e.g.,avatar server 116). For example, interface component 206, avatar controlcomponent 208, and avatar generation component 226 can be located at aremote server. According to this aspect, a user can access an interface,(e.g., using client device 106 for display at the client device)including the avatar performing various responses based on the user'sinput 234 via a network (e.g., at a website or other networkedplatform). The animation including the avatar can be provided to theclient device for rendering as streaming video streamed thereto from theserver. In another aspect, one or more components of avatar guidanceplatform 202 can be distributed between the server and the client. Forexample, a remote server can include the avatar control component 208while the client device can include the avatar generation component 226.According to this example, avatar control component 208 can send thecontrol commands to the client device via a network. Upon receipt of thecontrol commands, the avatar generation component 226 at the clientdevice can generate the avatar animation based on the control commands.

In an aspect, an avatar generated in association with providing guidanceand instruction to a user with respect to performance of a program,routine, or activity can inform the user via visual and/or audible(e.g., speech) responses how to perform the selected activity or programprior to beginning the program/activity and/or over the course of theprogram/activity. For example, when the selected activity is a fitnessroutine, an avatar can be generated and presented to the that performsat least part of the fitness routine so that the user can copy or followthe avatar. In another example, the user can have knowledge of what anactivity or program requires (e.g., a diet program, a daily routine, anaddiction recovery program) and an avatar generated to guide adherenceto the activity or program can simply respond to the user's adherence ornon-adherence to the requirements of the activity or program.

As previously noted, avatar guidance platform 202 can be employed toguide a user in association with performance of a variety of differentprograms, routines and activities. In one exemplary embodiment, avatarguidance platform 202 is employed to facilitate guiding a user through afitness routine or activity. Avatar guidance platform 202 can includefitness module to provide various features specific to this application.In another exemplary embodiment, avatar guidance platform 202 isemployed to provide a user with a personal guide or assistant tofacilitate adherence to a program or schedule. According to thisembodiment, avatar guidance platform 202 can include program guidemodule 232 to provide various features specific to this application.Fitness module 230 and program guide module 232 are discussed in greaterdetail infra.

FIG. 3 provides a high level flow diagram 300 of a process for guidingor assisting a user with adhering to a program, routine or activityusing an avatar in accordance with various aspects and embodimentsdescribed herein. Repetitive description of like elements included inrespective embodiments of systems and methods described herein isomitted for sake of brevity.

Process 300 involves receiving and processing various input data about auser's physical state and activity along with various other personal andcontextual information to facilitate guiding and assisting the user withperformance of a particular program, routine or activity viamanifestation of responses via an avatar based on the input. Inparticular, at 308, raw physical and physiological activity data 304 andcontext information 306 for a user is received and processed todetermine corresponding physical and physiological activity featurevalues and context metrics/parameters, respectively. The raw physicaland physiological activity data 304 can include biometric data, movementdata, and/or image data captured for the user via various sensor devicesattached to the user (e.g., sensor device 104) and/or various auxiliarydevices (e.g. intelligent fitness device(s) 118, visual capture device110, sensor module 112, etc.) as the user performs a specific program,routine or activity. The context information 306 can include locationinformation (including information about the location, such as weather,events, physical structures, etc.), time of day, and other real-timeuser input (e.g., input provided by the user regarding the user'sthoughts, feelings, desires, etc.).

For example, based on received physical and physiological activity data304, at 308 various information about a user's physiological state canbe determined (e.g., heart rate, blood pressure, temperature, caloriesburned, blood alcohol level, cortisol level, glucose level, etc.). Inaddition, based on received motion/movement data and/or image data overa period of time, pattern analysis can be employed to determine whatphysical movements the user is performing (e.g., jumping, running,performing a specific yoga pose, performing a chest press, etc.) as wellas characteristic about the movements (e.g., body position, speed,pressure, intensity, etc.).

At 310, the physical and physiological activity feature values andcontext metrics are processed to determine whether, how and to whatdegree the user deviates from the monitored program, routine oractivity. This processing can involve evaluation of the physical andphysiological activity feature values and context metrics in view ofmodel or reference physical and physiological activity feature metricsand/or reference context metrics for the monitored program, routine oractivity. For example, this processing can include comparison ofdetermined physical and physiological activity feature values and/orcontext metrics to corresponding reference metrics for the monitoredprogram, routine or activity to determine whether, how and to whatdegree the user's performance and behavior deviates there from. In anaspect, this processing can involve various classification schemes andthat relate different combinations of physical and physiologicalactivity feature values to one another based on the correspondingreference metrics to determine or infer whether, how and to what degreethe user deviates from the monitored program, routine or activity.

In addition to reference metrics, processing at step 310 can alsoinvolve analysis of received physical and physiological activity featurevalues and/or context information in view of requirements for thesevalues in association with performance of the monitored program, routineor activity, and based on user profile information 302. This profileinformation can include but is not limited to: user health information,user preferences, user demographics, user schedule, and user performancehistory in association with the monitored program, routine or activity,and/or other monitored programs, routines or activities for the user.According to this aspect, the physical and physiological activity andcontextual requirements for a program, routine, or activity can betailored to account for a user's physical capabilities, preferences andgoals, demographics, schedule, or history. Accordingly, where twodifferent user's perform the same routine and exhibit the same physicaland physiological activity feature values, one user can be determined todeviate the program while another could be determined to adhere to theprogram.

At 312, based on a determination of whether, how, and to what degree auser deviates from a monitored program, routine or activity, a responseis determined for manifestation by an avatar. The response is specificto the deviation (or determination of no deviation), the degree of thedeviation, the program, routine or activity being monitored, the user,and potentially the context of the user. In aspect, an avatarresponse/reaction is determined or inferred based in part on variousprefixed responses for the monitored program, routine, or activity andthe particular deviation, user profile information 302 and contextinformation 306. The response is specifically designed to provide theuser with guidance in association with adhering to the monitoredprogram, routine or activity. For example, where a user deviates from amonitored program, the response can include verbal and/or visualinstruction by the avatar to command and/or motivate the user to performan action to correct or accommodate the deviation. In another example,where it is determined that the user is properly adhering to a monitoredprogram or activity, a response could include a showing of praise andencouragement by the avatar. In another example, where it is determinedat step 310 that the user is likely to deviate from a program in theforeseeable future (e.g., by likely eating bad food based on adetermination the user is located at a fast food restaurant), theresponse can include a mechanism to prevent the user from deviating. Forexample, such a mechanism could include provision of motivationalcoaching, alternative options, or imagery and/or external source data bythe avatar that is selected to persuade the user to stick to theprogram.

After a response is determined at step 312, an avatar presented to theuser is directed to perform or implement the response. For example,avatar generation component 226 can generate and avatar that performsthe response based on control commands provided by avatar controlcomponent 208. These control commands are specifically designed byavatar control component 208 to cause the avatar to perform thedetermined response. For example, when the avatar response includesspeaking a phrase while performing a specific movement and smiling, thecontrol commands can direct avatar generation component 226 to generatean avatar that speaks the phrase while performing the specific movementand smiling.

FIG. 4 provides an example embodiment of fitness module 230 inaccordance with various aspects described herein. Repetitive descriptionof like elements included in respective embodiments of systems andmethods described herein is omitted for sake of brevity.

Fitness module 230 is specifically configured to facilitate guiding orassisting a user with adhering to fitness routine or activity using anavatar in association with various aspects of avatar guidance platform202. For fitness applications such as physical therapy, personaltraining, aerobics, performing a sports activity (e.g., gymnastics,golf, etc.), etc., the avatar plays the role of a virtual physicaltherapist, personal trainer or teacher. During the routine or activity,the user's physical inputs (e.g., physiological, motion, and/or imageinput) will automatically control the behavior of the avatar. Thebehavior of the avatar is designed to guide or assist the user with thefitness routine or activity. For example, the avatar's behavior canresemble that which a real trainer would exhibit to provide instruction,demonstration, motivation, praise, coaching, etc.

In particular, as a user performs a specific fitness routine oractivity, the user's physiological input is received by avatar guidanceplatform 202. The user's physical and physiological activity input isfurther processed by processing module 210 as it is received (inreal-time or near-real) to evaluate the user's adherence to the specificfitness routine or activity (e.g., by analysis component 212), inaccordance with aspects described herein. Based on this evaluation,responses/reactions are determined for manifestation by an avatar (e.g.,by avatar reaction component 214), in accordance with aspects describedherein. Avatar control component 208 and avatar generation component 226then cause an avatar presented to the user to perform theresponse/reactions.

For example, in accordance with various aspects of avatar guidancesystem 200 and fitness module 230, a user can begin performance of aselected or assigned fitness routine. An avatar is presented to the user(via a graphical user interface or as a hologram) to help guide the userthrough the routine and serve as the user's coach or trainer. Dependingon the selected fitness activity or routine, the avatar can beconfigured to perform some or all of the fitness routine with the userso that the user can mimic the movements of the avatar. In anotheraspect, the avatar can be configured to direct the user to performvarious actions in accordance with the routine and provide demonstrationof physical movements of the routine movements when necessary.

As the user performs the routine, avatar guidance platform 202 receivesphysical and physiological activity input data for the user inaccordance with aspects described herein. For example, when the user iswearing a heart rate monitor, information, identifying the user's heartrate is obtained. This information along with other potential physicaland physiological activity data related to the user's physiologicalstate, movement and appearance is evaluated as it is received todetermine whether, how, and to what degree the user's performancedeviates from the physical and physiological activity requirements ofthe fitness routine in view of personal characteristics of the user,such as physical restrictions/capabilities of the user. In an aspect,the user's physical and physiological activity data is compared oranalyzed based on reference information for the routine definingrequirements for the physical and physiological activity data inassociation with performance of the physical routine (e.g.,physiological metrics associated with respective movements and/or timesthroughout the routine, actions the user should perform to accomplishthe routine, when to perform them and how to perform them with respectto range or motion, body position, intensity, etc.). Analysis of thesereference metrics is further adapted based on user profile information(e.g., user physical restrictions, user physical capabilities, userdemographics, etc.).

Continuing with the subject example, during performance of a certainmovement of the fitness, the user's heart rate is determined to be 100beats per minute where the routine requires a person having the height,weight and age of the user to have a heart rate of 125 beats per minute.Thus analysis component 212 determines that the user deviates from theroutine based on having a heart rate below the optimal heart rate. Basedon this deviation, reaction component 214 determines a reaction formanifestation by the avatar presented to the user to encourage the useto increase his heart rate to 125 beats per minute. In an aspect,reaction component 214 can base this determination on the specificphysical routine, the type of deviation and degree of the deviation,prefixed responses for the routine and deviation, user profileinformation and potentially context information. Avatar controlcomponent 208 and avatar generation component 226 can then cause theavatar to perform the reaction. Continuing with the subject example, theavatar may visually increase the pace of the motion, provide verbalinstruction to increase speed, or a provide a visual or audibleindicator that increases the rhythm of the motion to encourage the userto match the pace. For instance, when performing alternating laterallunges (mimicking the motion of speed skating as they are also known)when moving side to side, one's heart rate should increase. If thetarget heart rate is not met, the speed at which an avatar demonstratingthe exercise is lunging side to side will increase until the targetedheat rate is met. Conversely, if the user's heart rate exceeds thetarget zone, the avatar will slow down until the user's heart rate alsodrops. In another example, the avatar can change aspects (e.g., therhythm, the song, the volume, etc.) of music playing to motivate theuser to increase his pace.

By customizing and automatically responding to changes in the user'sbiometric data, the avatar guidance system 200 improves user safetyduring physical exercise. In particular, the avatar guidance system 200is configured to respond to user input automatically and in real-time,thereby providing indication of a potentially dangerous activity inadvance of an unsafe result. For instance, if the system recognizescertain metrics as leading to bodily harm, the system can instruct theavatar to stop the workout session and contact a health professional orautomatically send a notification (e.g., a call, electronic message,etc.) to the health professional. If necessary, the system canadditionally or alternatively be configured to contact emergencyservices, thus saving precious time in the event of a severe orpotentiality life threatening injury.

To provide for various aspects of avatar guidance system 200 whenapplied to facilitate a fitness routine or activity, fitness module 230can include routine selection component 404, routine builder component406, preview component 408, avatar customization component 410, routineadaptation component 412, comparison demonstration component 414 andreporting component 416. Fitness module 230 can also include variousdata objects stored in memory 418 (which can be inclusive of memory 218)that are specific to aspects of fitness module. These data objects caninclude information defining various fitness routines/activities 420 andactivities capable of being monitored by fitness module 230, informationdefining various fitness movements or moves 422 capable of beingperformed by an avatar in association with a fitness routine oractivity, and historical information for respective users logging theirperformance of fitness routines or activities using fitness module 230.

Routine selection component 404 is configured to allow a user of fitnessmodule 230 to select a preconfigured fitness routine or activity toperform from a database of routines/activities 420. Each of theseroutines or activities have a defined set of physical moves andrequirements for the user to perform. For example, the routine oractivity can include an aerobics routine, a physical therapy session, astrength training exercise, a yoga routine, a dance routine, a golfexercise, a running workout, a biking workout, kickboxing workout, etc.The routine or activity can be designed for performance in a fixed spaceindoors or outdoors, over changing indoor or outdoor terrain, and/orusing various equipment or apparatuses.

In another aspect, rather the selecting a stock fitness routine oractivity to perform, routine builder component 406 can facilitatedesigning a custom routine for the user to perform. In an aspect,routine builder component 406 can allow the user (or a supervisor of theuser), to build a custom fitness routine or activity by selectingvarious fitness moves to include in the routine or activity andselecting physical and physiological activity parameters associated withperformance of the fitness moves. For example, using a database of aplurality of known physical movements capable of being performed by ahuman in association with a wide variety of fitness activities (e.g.,moves database 422), the user can pick and chose various moves and/orcombinations of moves to include in a fitness routine. For instance,when designing an aerobics routine, the user can select differentaerobics moves can combinations of moves from a database of possiblemoves. In association with selecting moves, the user can also selectcharacteristics associated with performance of the moves, such asintensity, duration, frequency, range of motion, speed, etc. Forexample, when designing a strength training routine, the user can selectwhat weight lifting movements to perform, weight to employ for eachmovement, number of repetitions, number of sets, range of motion, etc.

Still in yet another aspect, routine builder component 406 can beconfigured to design a custom fitness routine or activity for a userbased on the user's needs, desires, physical abilities and context. Inparticular, avatar customization component 410 can design a customizedfitness routine or activity for a user to perform based on user profileinformation including but not limited to: information describing theuser's demographics, physical profile (e.g., height, weight, physicalabilities, physical injuries or restrictions, etc.), preferences (e.g.,what types of activities the user prefers or dislikes), goals (e.g.,fitness activity performance goals, weight loss/gain goals, musclebuilding goals, etc.), and monitored physical performance history,(e.g., history of fitness routines/activities the user has completed andsummary of the user's performance). For example, based on user profileinformation, routine builder component 406 can design a customizedroutine for the user to perform that includes moves the user is capableof safely performing, moves the user prefers, moves that will challengethe user and facilitate achieving the user's goals, moves that the userdid not perform yesterday, etc.

In addition, avatar customization component 410 can analyze contextinformation when designing or selecting a customized routine or activityfor a user to perform. For example, avatar customization component 406can consider the user's location, the time of day, the amount of timeavailable to the user, the current weather associated with the location,and fitness equipment/apparatuses available to the user. In an aspect,in association with designing a customized routine for a user, routinebuilder component 406 can receive user input providing some desiredcharacteristics for the routine. For example, the user can provideinformation regarding a type of activity the user would like to performthat day, (e.g., cardio, weight training, yoga, kickboxing,running/biking outside, etc.), one or more muscle groups the user wouldlike to work on, the desired duration of the activity.

In an aspect, an avatar generated and presented to a user in associationwith performance of a fitness routine or activity can perform themovements of the fitness routine or activity. While designing a fitnessroutine or activity and/or prior to performing a fitness routine oractivity, the user may desire to see a demonstration of one or more ofthe physical moves required by the activity. Preview component 408 isconfigured to generate an avatar that demonstrates one or more movesselected for inclusion in a fitness routine or activity prior tobeginning performance of the routine or activity. For example, a usercan select a stock routine or activity and/or select a custom routinethat has been designed for the user (e.g., automatically by routinebuilder component 406) and then select preview component 408 to bepresented with an avatar that demonstrates one or more of the movesincluded in the selected routine or activity. Based on the preview, theuser can decide whether or not to proceed with performance of theselected routine or activity.

In another aspect, while designing a custom fitness routine or activity,the user can view an avatar demonstrating a chosen move or combinationof moves based on the requirements selected for the move or combinationof the moves (e.g., speed, intensity, range of motion, etc.). Forexample, the user can select a series of yoga poses to include in a yogaroutine and the select preview component 408 to view the series of yogaposes being performed by an avatar. If the user is unsatisfied with themanner in which the poses flow based on the preview, the user can changeaspects of the selected pose series. In an aspect, when viewing thepreviewed demonstration of a fitness move or moves, preview component408 can allow the user to change the perspective of view of the avatar.For example, the user can rotate a virtual camera pointed at the avatarto various viewpoints (e.g., 360° with respect one or more axis) of theavatar so that the user can view the avatar's body position duringperformance of the fitness move from various points of view.

Avatar customization component 410 allows a user to customize the avatarpresented to the user to facilitate a fitness routine or activity. In anaspect, avatar customization component 410 can allow the user tomanipulate variables to create an avatar that reflects the needs andtastes of the user. In particular, using avatar customization component410, a user can select the avatar's appearance, demographics, voice andpersonality. For example, the age, gender, language or accent, dress, orother visual and/or audio characteristic of the avatar may be selectedto motivate and/or comfort the user. In another aspect, avatarcustomization component 410 can provide predetermined character personasfor the user to select and apply to his or her avatar. For example, theavatar can be selected from a familiar character set that includes knowncartoon characters or people (e.g., famous actors, musicians,politicians, athletes, etc.) where such characters creators or personshave authorized usage of their persona. For example, a cartoon avatarmay be suitable to lead a child user through an exercise regime, or apopular athlete or fitness trainer may motivate an adult user to adhereto a fitness program.

In another aspect, avatar customization component 410 can automaticallydesign an avatar to facilitate a user with a fitness routine oractivity. According to this aspect, avatar customization component 410can select the avatar's appearance, demographics, voice and personalitybased on one or more of: the fitness routine or activity selected forperformance, profile information for the user regarding the user'spreferences, the user's demographics, and the user's performance historywith respect to monitored fitness routines or activities. For example,based on analysis of the user's preferences and demographics, avatarcustomization component 410 can determine or infer what type of avatarin terms of appearance and personality would best facilitate/motivatethe user in association with performance of a selected fitness activityor routine (e.g., based on data relating avatar appearance and charactertraits to various aspects of user profile information).

In an aspect, an avatar configured to facilitate performance of afitness routine or activity be configured to perform the fitness routineor activity so that the user can mimic the avatar. For example, aselected fitness routine or activity has known movements andrequirements that can automatically control the movements of the avatar.In another aspect, avatar customization component 410 can allow a userto select the manner and degree to which the avatar performs the movesof a fitness routine or activity. For example, using avatarcustomization component 410, the user can select the degree of physicaldemonstration and instruction the user would like his or her avatar toprovide. According to this example, the user could select fullperformance mode wherein the avatar is configured to perform the fitnessroutine or activity in full, or partial performance mode wherein theavatar is configured to perform parts of the routine or activity (e.g.,provide a short demonstration of each new movement of a fitness routineor activity, provide demonstration of a move during a fitness routine oractivity only upon request of the user during the course of the routineor activity, etc.). In another example, the user could select instructmode wherein the avatar is configured to provide only verbal instructionregarding performance of a fitness routine or activity with theexception of a physical movement demonstration reaction determined byreaction component 214. In another example, avatar customizationcomponent 410 can allow the user to select correction mode wherein theavatar is configured to only demonstrate a move when the user performsit improperly.

Routine adaptation component 412 is configured to dynamically adaptaspects of a fitness routine or activity being performed by a user basedon received physical and physiological activity data for the user, userprofile information and potentially user context information. Forinstance, in some aspects an avatar's reaction to user performancedeviating from a fitness routine or activity includes a visual or verbalcue to help or motivate the user correct the deviation. For example,when a user is moving too fast or too slow, the avatar's reaction isdesigned to cause the user to slow down or speed up, respectively. Inother aspects, an avatar's reaction to user performance adhering to thefitness routine or activity (e.g., the user is performing the routinecorrectly with respect to physical and physiological activityrequirements of the routine) is designed to simply provide praise to theuser and encourage the user to keep up the good work.

However, in various additional aspects, an avatar's response to a user'sperformance deviating from or adhering to a fitness routine or activitycan involve adaptation of requirements of the routine or activity,changing of the fitness routine or activity, and/or stopping of thefitness routine or activity. For example, in some situations where auser's physical and physiological activity performance is belowstandard, rather than pushing the user to improve his or herperformance, it may be more appropriate to have the user to take a breakand rest, stop performance altogether (e.g., where physical andphysiological activity input is indicating the user is at risk forphysical injury), have the user perform an easier version of the fitnessroutine, or have the user perform an different routine or activity. Inanother example, in situations where a user's physical and physiologicalactivity performance is above standard and/or consistently on point,rather than merely praising the user for the good performance andencouraging the user to keep it up, it may be more appropriate toincrease the intensity or difficulty level of the fitness activity orhave the user advance to a new fitness activity that focuses on a newmuscle group or skill set.

According to this aspect, fitness module 230 can include routineadaptation component 412. Routine adaptation component 412 is configuredto dynamically determine whether and how to adapt or change the physicaland physiological activity requirements of a fitness routine or activityduring performance of the fitness routine or activity by a user, and/orwhether and how to change the fitness routine or activity beingperformed by the user during performance of the fitness routine oractivity be the user. In response to a determination to adapt a fitnessroutine or activity during performance of the fitness routine oractivity by the user, routine adaptation component 412 can directprocessing module to evaluate the user's performance based on theadaptation (e.g., new physiological and/or motion or pressure referencemetrics). In addition, routine adaptation component 412 and/or reactioncomponent 214 can determine a reaction for manifestation via the avatarto inform the user regarding the adaptation and facilitate performanceof the routine by the user with the adaptation. This determined reactioncan be then be automatically effectuated by avatar control component 208and avatar generation component 226 during performance of the fitnessroutine or activity by the user.

In an aspect, routine adaptation component 412 is configured to makedeterminations regarding whether and how to adapt a fitness routine oractivity based on analysis of a degree, consistency and frequency of adeviation or non-deviation during performance of the routine (e.g., withrespect to degree, consistency and frequency thresholds for thedeviation in association with performance of the routine), user profileinformation and/or context information. For example, routine adaptationcomponent 412 can be configured to adjust the requirements of a fitnessroutine or activity based on consistent performance of the fitnessroutine or activity below standard performance, above standardperformance, or at standard performance, wherein consistency isevaluated based on reference metric thresholds for frequency andduration of the deviation or non-deviation and/or degree of thedeviation. For example, where a user consistently performs below therequired amount of reps on a weight machine, routine adaptationcomponent 412 can determine that the amount of reps and/or weight shouldbe lowered. In another example, where a user continually throws fartherthan a required distance, routine adaptation component 412 can determinethat the required distance should be increased. In yet another example,where a user consistently performs a fitness move at a requiredintensity yet does not have an increase in heart rate, routineadaptation component 412 can determine that the required intensity ofthe fitness move should be increased.

Routine adaptation component 412 can also base a determination regardingadjustment of requirements of a fitness routine or activity based onuser profile information, including but not limited to: historicalperformance of the user in association with performance of monitoredfitness routines or activities, goals of the user, current physicalstate of the user, preferences of the user, and/or physical capabilitiesand limitations of the user. For example, where it is determined that auser is consistently completing reps on a weight machine at a requiredweight and the user has previously been able to lift more weight (in apast workout), routine adaptation component 412 can adapt therequirements of the routine to increase the number of reps and/orweight. In another example, where a user is continually nailingperformance of a certain yoga pose during performance of a selected yogaroutine, routine adaptation component 412 can change the selected yogaroutine to include a more advanced pose. When selecting the moreadvanced pose, routine adaptation component 412 can consider poses thatare safe for the user to perform in light of a known back injury andcertain yoga poses that the user prefers or does not prefer. In yetanother example, when a user is becoming extremely fatigued during acardio aerobics routine based on consistent performance below thephysical and physiological activity requirements of the routine, routineadaptation component 412 can adjust the intensity requirements of theaerobics routine by including easier moves the user prefers or change amuscle group focused on (e.g., from legs to abdominals) based onknowledge that the user has not worked the new muscle group in over aweek.

Routine adaptation component 412 can also consider contextualinformation when determining whether and how to adjust requirements of afitness routine or activity during performance of the fitness routine oractivity. For example, when a user is running outside and thetemperature increases by N degrees, routine adaptation component 412 canadjust the required speed or duration of the run to accommodate for theintensity increase associated with the rise in temperature. In anotherexample, during performance of a fitness activity, the user may providefeedback stating ‘this is too hard,’ or ‘this is too easy.’ Based onsuch feedback and information regarding whether and to what degree theuser is deviating from the requirements of the fitness activity, routineadaptation component 412 can determine whether and how to adjust therequirements of the fitness activity.

In response to a determination by routine adaptation component 412 tochange the requirements of a fitness routine or activity (e.g., changethe speed, intensity, exercise move, range of motion, difficulty level,muscle group worked, etc.) and/or change the fitness routine or activityall together (e.g., stop performance or select a new routine or activityfor performance by the user), routine adaptation component 412 can adaptthe requirements of the routine accordingly. As a result, adherence tothe fitness routine or activity will be evaluated (e.g., by analysiscomponent 212) based on the adapted requirements. In addition, theavatar presented to user can provide a visual and/or audible responsethat informs the user regarding the adaptation. In particular, based ona change to a fitness routine or activity determined by avataradaptation component 412, routine adaptation component 412 and/orreaction component 214 can determine a reaction/response formanifestation by the avatar that informs the user regarding the changeand/or facilitates performance of the routine with the change. Thisreaction can involve a verbal cue informing the user about the changeand/or a physical demonstration by the avatar of the routine or activitywith the change.

For example, the avatar can demonstrate a new move or demonstrate a moveat a different intensity while informing the user how to perform the newmove or the move at the different intensity level. In some aspects, whenan avatar is configured to perform the fitness routine for the user tomimic (e.g., an aerobics routine), the avatar can perform the fitnessroutine as adapted by routine adaptation component 412. For example,while performing a selected fitness dance routine, the avatar candynamically change the moves, intensity of the moves, music associatedwith the routine, etc. over the duration of the routine based ondeterminations by routine adaptation component 412.

In an aspect, fitness module 230 can include reporting component 416 toprovide real-time feedback regarding a user's performance of a fitnessroutine or activity to a remote entity, such as the user's humanphysical trainer or therapist at a remote location. For example,reporting component 416 can communicate any information received and/orprocessed by avatar guidance system to a remote entity via network as itis received and/or determined (e.g., in real-time). This information caninclude input 234 (e.g., raw physical and physiological activity data,user profile information, context information) received by avatarguidance platform, determinations regarding adherence or deviation froma fitness routine or activity performed by a user, anddetermined/manifested avatar responses.

The remote entity can also communicate with avatar guidance platform 202during performance of the fitness routine or activity by the user.Therefore, in an aspect, rather than having routine adaptation component412 automatically determine and effectuate changes to a fitness routineor activity as the user performs it, a remote entity can determine suchchanges based on received information. The remote entity can furthercommunicate the changes to routine adaptation component 412 and routineadaptation component 412 can effectuate the changes determined/requestedby the remote entity. In particular, based on the changes to a fitnessroutine determined and communicated to fitness module 230 by the remoteentity, adherence to the fitness routine or activity will be evaluated(e.g., by analysis component 212) based on the changes. In addition, theavatar presented to user can provide a visual and/or audible responsethat informs the user regarding the adaptation. In particular, based ona change to a fitness routine or activity determined by the remoteentity, routine adaptation component 412 and/or reaction component 214can determine a reaction/response for manifestation by the avatar thatinforms the user regarding the change and/or facilitates performance ofthe routine with the change.

Comparison demonstration component 414 is configured to generate acomparison visualization between an avatar performing a correctdemonstration of a fitness move and a representation of the user (e.g.,in an avatar form or a video replay of the user) as the user performedthe move incorrectly. For example, if the user repeatedly performs amove incorrectly, avatar comparison component 414 can generate a secondavatar configured to perform the move in the manner in which the userperformed it incorrectly (e.g., based on motion data and/or image datacollected for the user). In another aspect, the avatar comparisoncomponent 414 can collect video footage of the user as the userperformed the move incorrectly. Comparison demonstration component 414can the generate a side by side comparison visualization of an avatarperforming the move correctly and another avatar representing the user(e.g. or the video footage of the user) performing the move incorrectly.Thus, a side by side comparison of the user's own actions and thevirtual personal trainer model technique can be displayed.

FIG. 5 presents an example user interface 500 that facilitates receivinguser profile information in association with employment of avatarguidance system 200 for physical fitness purposes in accordance withvarious aspects and embodiments described herein. Repetitive descriptionof like elements included in respective embodiments of systems, methodsand interfaces described herein is omitted for sake of brevity.

In an aspect, a user can establish a profile with avatar guidance system200 that includes a variety of personal information related to the userand the user's usage of avatar guidance system 200. For example, whenemploying avatar guidance system 200 for fitness and health relatedpurposes, a user can be present with interface 500 to facilitateestablishing a user profile and entering various personal informationrelated to the user's health and fitness profile. For instance,interface 500 include can information section 502 that facilitatesreceiving user input regarding the user's physical profile, the user'sphysical limitations, and the user's dietary restrictions. Interface 500can also include section 504 that presents an interactive pictorialrepresentation of a human with the various muscle groups displayed. Inan aspect, using this section the user can select body parts and/ormuscle groups to indicate where the user has injuries and/or physicallimitations.

FIG. 6 presents an example user interface 600 that facilitates designinga custom fitness routine in association with employment of avatarguidance system 200 for physical fitness purposes in accordance withvarious aspects and embodiments described herein. Repetitive descriptionof like elements included in respective embodiments of systems, methodsand interfaces described herein is omitted for sake of brevity.

In various aspects, a user or an authorized supervisor of the user(e.g., the user's fitness trainer, physical therapist, doctor, parent,etc.), can design a custom workout to perform and have guided by anavatar presented to the user. For example, the user can design anexercise routine with various selected moves and characteristics andrequirements for the moves, such as number of repetitions, time betweenrepetitions, duration, frequency, range of motion, intensity, etc.Accordingly, the user can select/manipulate various variables to createa workout program specifically designed to match a user's needs,preferences, physical limitations, and goals.

Interface 600 provides an example tool for designing a fitness routinein accordance with aspects described herein. The left side of theinterface includes column 602 which includes a plurality of differentmenu categories to select in association with designing a customworkout. In an aspect, column 602 provides the capability to choose atype of workout desired from a plurality of different menu options thatcorrespond to categories of workout types, such as body part specific,cardio, chaos, core, golf specific, rehab, etc. For example, the‘sprint’ workout category is selected in example interface 600. The usercan further customize various aspects of a selected workout usingvarious potential sub-category options available via a drop down menufrom a selected menu category of column 602. These sub-categories canvary depending on the workout category selected. For example, thesesub-categories can correspond to different parts of a workout (e.g.,warm up, cool down, high intensity portion, cardio portion, etc.),different machines/tools or weights used in association with theworkout, different rounds or circuits of a workout, etc. In anotherexample, these sub-categories can correspond information regarding whenthe workout is to be performed in association with a workout program. Inother aspect, the user can define sub-categories of a workout type menucategory.

As exemplified in interface 600 the user has selected the ‘sprint’workout for week 1 day 1 and week 1 day 2 of a workout program. Thesub-category week 1 day 1 is currently selected (as indicated byhighlighted column 610). This sub-category includes additional drop-downsub-categories corresponding to different parts of the workout,including circuit 1, circuit 2, circuit 3 and cool down. The user canselect each of the part of the workout and define exercise moves (andcharacteristics of the exercise moves) to include therein. For example,with respect to circuit 1, the user has selected the following exercisemoves: knees across, speed skaters, side kicks, upper cuts and rear deltpult. In column 604, the user can select the number of repetitions tocomplete for the respective parts of the workout. For example, each ofcircuit 1, circuit 2, circuit 3 and cool down are selected for repeatingonce (as indicated by the number 1 next to each part of the workoutunder column 604.

Column 606 corresponds to animation. In particular, a description of theselected exercise move appears in column 606 to indicate what the moveis at it will be demonstrated by an avatar presented to the user.Additional information describing how the animated avatar will appearwhen demonstrating the move in accordance with the definedcharacteristics of the move (e.g., speed, range of motion, etc.) canalso be included in column 606. Column 608 corresponds to the number ofexercise moves reps selected for completion. For example, the user hasselected to perform 19 repetitions of ‘knees across.’

In an aspect, section 616 of interface 600 facilitates defining variouscharacteristics of a selected exercise move and section 614 provides avideo animation demonstration of an avatar 620 performing the selectedexercise move in accordance with the selected characteristics. Forexample, on the left side of the interface, the user has move ‘kneesacross’ is currently selected (as indicated by highlighted row 612).Using section 616, the user define the various requirements for theexercise ‘knees across,’ such as number of repetitions, rate of therepetitions, time to complete the repetition, amount of time delaybetween repetitions, whether the exercise is a training exercise, rangeof motion, speed of the exercise, etc. It should be appreciated that avariety of different feature requirement selections can be provided insection 616 (e.g., heart rate, blood pressure, speed, etc.) which canalso vary depending on the selected exercise.

After a user has selected specific requirements for an exercise insection 616, the user can select the preview button 618 to see a previewdemonstration of the avatar 620 displayed in section/window 614performing the exercise in accordance with the specified requirements.In an aspect, as the user previews the avatar 620 performing theexercise, the user can change the viewing angle at which the avatar isdisplayed (e.g., of a virtual camera pointed at the avatar 620) to seehow the movements are demonstrated from different views of the avatar.

For example, depending on the demonstrated exercise, a side or frontview may provide a more helpful perspective of the avatar model. Inaddition, section 616 includes a tips category 622, wherein the user canprovide personalized tips, instruction, or messages to be provided tothe user (e.g., in an audible format, spoken by the avatar, etc.) whenthe user performs the exercise. For example, the user can provide adescription of what the move is, how to perform the move correctly, whatnot to do when performing the move, a motivational quote, etc.). Thesetips can be configured for rendering to the user (e.g., in an audibleformat, spoken by the avatar, etc.) when the user performs the specificexercise move during the workout.

FIG. 7 presents an example user interface 700 that presents a user withan avatar to facilitate guiding the user through a selected fitnessroutine in accordance with various aspects and embodiments describedherein. Repetitive description of like elements included in respectiveembodiments of systems, methods and interfaces described herein isomitted for sake of brevity.

In an aspect, interface component 206 can generate interface 700 forpresentation to a user (e.g., via rendering component 236) duringperformance of a selected fitness routine or activity. Interface 700includes an avatar 712 displayed within a workout space 710. Theappearance of the avatar and/or the workout space are customizable(e.g., via avatar customization component 410). In an aspect, asdescribed above, the avatar 712 is configured to function as the user'spersonal trainer and provide instruction to the user regardingperformance of the selected fitness routine. In particular, the avatar712 is configured to respond in real-time to physical and physiologicalactivity input received for the user as the user performs the fitnessroutine in accordance with aspects described herein. For example, as theuser performs a fitness routine, the avatar 712 can provide variousreal-time reaction to the user's performance based on received andanalyzed physical and physiological activity data for the user (e.g., inaccordance with aspects described herein). For instance, the avatar cancall out commands, tell the user how to correct certain physicaldeviations from the routine (e.g., based on physiological data and/ormovement data for the user), provide physical demonstration of moves,motivate the user with facial and body movement expression, etc. Asdescribed above, these reactions can be specifically tailored to theuser's personal tastes, goals and abilities (e.g., based on user profileinformation) and/or the user's current context (based on receivedcontext information). In some aspects, the avatar 712 is configured toperform the fitness routine for the user to follow. In other aspects,the avatar can perform parts of the fitness routine during performanceof the fitness routine by the user when demonstration is necessary(e.g., to correct improper technique by the user).

Interface 700 can also include various tools and menu options tofacilitate customizing aspects of the workout routine and/or theappearance of the interface. For example, interface 700 can include a‘select environment section’ 702 wherein a user can select a backgroundenvironment (e.g., a beach, a city, mountains), for display in theworkout space 710. Interface 700 can also include section a ‘selectmusic section’ 704 which allows the user to select a type of music forplaying during a workout. In an aspect, this section can be linked toanother music database (e.g., the user's playlist or an external mediastreaming system) to allow for selection of a wide variety of musicoption. Section 706 includes a ‘modify exercise section’ wherein a usercan modify various aspects of an exercise prior to or duringperformance. For example, the user can select the intensity of theworkout (e.g., 60%, 80%, 100%, etc.). Modify exercise section 706 canalso provide for selection of a fitness program and or workout toperform and/or modification of a selected workout program or routine. Inorder to begin a selected workout, the user can select the begin button.In an aspect, prior to beginning the workout, the user can select thepractice button which takes the user through various simulations of therespective exercises in the routine as demonstrated by the avatar 712.

Interface 700 can also include various visual feedback areas (e.g., 714and 716) that provide the user with information regarding the user'sperformance during the workout. For example, interface 700 can include aheart rate meter 714 that displays the user's current heart rate next toa target heart rate range marker. In an aspect, the heart rate meter 120can change colors to provide an indication whether the user is above,below or at the target heart rate. In another example, area 716 canprovide real-time feedback regarding an amount of calories the user hasburned, the current exercise the user is performing, the number ofrepetitions completed and the current time point in the workout.Further, interface 700 can provide the user with various informationsections, such as a goal section 708 noting the user's goals and thegoals set by the user's trainer, and a limitation section 718 notingphysical limitations of the user.

FIG. 8 provides another example embodiment of fitness module 230 inaccordance with various aspects described herein. Repetitive descriptionof like elements included in respective embodiments of systems andmethods described herein is omitted for sake of brevity.

In accordance with the subject embodiment, fitness module 230 can alsoinclude avatar interaction component 802 and live group fitnesscomponent 804. Avatar interaction component 802 is configured tofacilitate generating and presenting an avatar to a user that isresponsive to not only the user's physical state and context but thephysical states and contexts of one or more other users. In an aspect,avatar interaction component 802 provides a virtual gaming experiencebetween two or more users. According to this aspect, the two or moreusers can request to participate in a “gaming” or “interactive mode” fora specific monitored program, routine, or activity. Each of the userscan grant authorization of sharing information (e.g., in real-time ornon-real time) regarding their respective performance of the program,routine, or activity between one another's user sessions. Depending onthe nature of the program, routine or activity and the gaming orinteractive mode selected, any of the users' avatars can react to bothfeedback about themselves and feedback about the other users.

In particular, avatar interaction component 802 can receive and analyzefeedback for a primary user to which an avatar is presented and one ormore other users that are also employing avatar guidance system 200 toperform a similar monitored program, routine or activity. Based onfeedback indicating how the other one or more users are performing themonitored program, routine, or activity, avatar interaction component802 can direct analysis component 212 and reaction component 214 todetermine an appropriate reaction for the primary user's avatar. Forexample, a group of users at various different locations around theworld can be involved in a running club. Using avatar guidance system200 the respective users can set up group runs where they respectivelyset out to run a same distance together in a race format. For example,each of the users can select the same distance and terrain, start therun at the same time, and have their respective avatars serve as theirindividual coaches throughout the run. However, not only can therespective avatars respond and react to their respective user's feedback(e.g., as discussed herein), the respective avatars can also react tofeedback received for any of the participating users in the group. Forexample, assuming the respective users' names are Abby, Bobby, Carmen,Donna, and Erin. Erin's avatar can tell Erin when to speed up, when toslow down, how to breath, etc. based on physical and physiologicalactivity feedback received for Erin and Erin's personal profile andhealth information. In addition, Erin's avatar can tell Erin when tospeed up and when to slow down based on how Abby, Bobby, Carmen, andDonna are performing when the goal is to win the race. For example,Erin's avatar can note where the other users are in terms of position,speed, fatigue, cramping, etc. Based on this information for example,Erin's avatar can tell Erin to slow down and save some energy for thenext mile because she is way ahead of the pack.

It should be appreciated that the above noted group race running exampleis merely one application of avatar interaction component 802. Forexample, avatar interaction component 802 can facilitate real-timeinteraction between two or more users participating together in avariety of different fitness programs routines or activities whether thegroup participation is competitive in nature (e.g., a tennis match, aboxing match) or collaborative in nature (e.g., a soccer match where thegroup of users are on the same team).

Group fitness component 804 is configured to provide a group fitnessatmosphere for two or more users of avatar guidance system 200 that havechosen to participate in a group fitness routine. The routine isconsidered a group fitness routine because the two or more users haveselected to perform the same routine at the same time (or substantiallythe same time) and the two or more users have authorized sharing of oneor more aspects of their personal avatar experiences with one anotherduring performance of the group fitness routine.

In an aspect, group fitness component 804 can facilitate generation of ashared user interface that is presented to the respective usersparticipating in the group fitness routine. In one aspect, the interfacecan include avatars representative of the respective users in the group.As the respective users perform the fitness routine, their respectiveavatars can mimic what the real users are doing (e.g., their movement,facial expression, sounds, etc.). Thus the interface presented to anyone of the respective user's can resemble that of a real and live groupfitness classroom (or other share environment) in which all the user'sare present together and performing the fitness routine together.

In another aspect, group fitness component 804 can facilitate generationof a shared trainer or coach to facilitate the group fitness routine.According to this aspect, each of the participating users can bepresented with the same avatar coach or trainer. This avatar can respondto user feedback for each of the respective users in accordance with theaspects described herein. However, the responses provided by the avatarcan be based on any one of the users' individual feedback or based onthe collective feedback received by the group. For example, the avatartrainer can instruct one of the group fitness participants to pick upthe pace and then demonstrate a movement to encourage the participant topick of the pace. This avatar response directed to one of theparticipants can be seen and heard by each of the participants in a livemanner. Similarly, using avatar interaction component 802, the sharedtrainer can respond to one of the group member's feedback on feedbackfrom other users participating in the group fitness class. For example,the trainer can point out the perfect form exhibited by one of the groupfitness members to the other group fitness members. In another example,the avatar trainer can tell a first group fitness member to kick hislegs higher (based on the particular fitness move) like a second groupfitness member is doing.

In another aspect, group fitness component 804 can provide for a sharedtrainer experience wherein each of the participants are monitored by thesame avatar respectively presented thereto and see and hear the sameavatar reactions in a live fashion. However, rather than reacting toindividual users, group fitness component 804 can direct routineadaptation component 412 to dynamically modify the routine based oncollective feedback from the users as a group. For example, in responseto a determination that the majority of the uses in the group arebecoming extremely fatigued, the routine adaptation component 412 canadapt the group fitness routine accordingly. In response, the sharedavatar trainer can instruct the group regarding the adaptation of theroutine.

FIG. 9 provides an example embodiment of program guide module 232 inaccordance with various aspects described herein. Repetitive descriptionof like elements included in respective embodiments of systems andmethods described herein is omitted for sake of brevity.

Program guide module 232 is specifically configured to facilitateguiding or assisting a user with adhering to a program using an avatarin association with various aspects of avatar guidance platform 202. Inparticular, program guide module 232 is configured to guide a user withperforming a program having a plurality of predetermined actions orbehaviors for the user to perform (or not perform) over a period of timeto achieve a goal of the user. The period of time and goal can vary.However, program guide module 232 is particularly suited for guiding auser through a program that lasts several hours, days, weeks or evenmonths wherein user input 234 is received over the course of theprogram. For example, a suitable program can include a health andfitness program designed to cause the user to get in better shape andhealth over a period of three weeks. In another example, a suitableprogram can include a stress reduction program designed to help a userreduce and combat stress throughout her day. Other examples of suitableprograms include an addiction recovery program, a weight loss program,an anger management program, and any conceivable program that includesperformance or non-performance of specific user behaviors whereinadherence can be monitored based on analysis of received physical andphysiological activity information for the user and/or contextinformation for the user.

During performance of a monitored program, information regarding one ormore of the user's physiological state, body movement/position,appearance, and context (e.g. location, time of day, people near theuser), is dynamically received and analyzed in view of knownrequirements of the monitored program, and in some aspects user profileinformation, to determine or infer whether, how and to what degree theuser deviates and/or is likely to deviate from the monitored program (inaccordance with aspects described herein). Based on this analysis,reaction component 214 determines or infers a suitable reaction formanifestation by an avatar presented to the user and the avatar controlcomponent 208 and avatar generation component 226 causer the avatarpresented to the user to perform the reaction. The reaction isconfigured to provide the user with guidance and/or motivation withadhering to the program and can include visual and audible reactions inthe avatar (e.g., speaking, moving, facial expression, tone of voice,etc.). In some aspects, the reaction can include initiation ofelectronic communication (e.g., sending a notification, initiating anemergency call), and provision of external media (e.g., images,articles, a map, videos, songs, etc.) to the user to facilitate guidingthe user with adherence to the program.

For example, a user can select a health and fitness program to performand have monitored by avatar guidance platform 202. The health andfitness program can include a specific fitness and diet regimen that theuser is to follow for a period of 21 days. Over the course of theprogram, reception component 204 can receive information indicating whatfood and drink the user has consumed (e.g., as input directly by theuser, as provided/determined via various biometric sensors input, asdetermined via image analysis of food eaten by the user, etc.) and whenthe user has consumed it. Reception component 204 can also receiveinformation regarding how many calories the user has consumed andburned, user activity/motion levels, user sleep patterns, and physicalperformance of fitness activities. Reception component 204 can alsoreceive information related to the user's context (e.g., where the useris located, what people, places, things and events are associate withthe location, time of day, how the user is feeling, etc.). In addition,information regarding the user preferences, physical health, physicalmeasurements (e.g., height, weight, BMI, body fat, etc.), performancehistory, schedule, etc., can be included in an accessible profile forthe user.

According to this example, based on the dynamically received user inputand the user profile information, analysis component 212 can determinewhen the user is deviating or is about to deviate from the health andfitness program. For example, analysis component 212 can determine orinfer whether the user is eating the required/appropriate food anddrink, whether the user is about to make bad food choices, whether theuser burned/is burning the required amount of calories in a workout,whether the user performed/is performing a required workout, whether theuser is performing the required workout in accordance with requirementsfor the workout, etc. Based on such determinations and/or inferencesregarding whether, how and to what degree the user is deviating or isabout to deviate from the requirements of the health and fitnessprogram, an avatar presented to the user can react in a manner to keepthe user on track with the program.

Accordingly, the avatar can function as the user's personalized guideconfigured to follow the user and track the user's behavior and physicalstate over the course of program and help the user adhere to theprogram. To provide for various aspects of avatar guidance system 200when applied to facilitate a guiding a user through a program, programguide module 232 can include program selection component 902, programbuilder component 904, avatar customization component 906, programadaptation component 908 and reporting component 910. Program guidemodule 232 can also include various data objects stored in memory 912(which can be inclusive of memory 218) that are specific to aspects ofprogram guide module 232. These data objects can include informationdefining various programs 914 capable of being monitored by programguide module 232 and historical information for respective users loggingtheir performance of various programs 232 using program guide module.

Similar to routine selection component 404 that provide for userselection of various preconfigured fitness routines for a user to selectfor performance, program selection component 902 provides for userselection of a program for performance by the user from a database ofknown programs 914 and associated requirements. For example, programsdatabase 914 can include a plethora of different programs arranged byvarious categorical types (e.g., health and fitness, weight loss, weightgain, marathon training, low sugar diet plan, stress reduction plan,sleep regulation programs, addiction recovery program, etc.). In anaspect, each of these programs can include a description of therequirements of the program and the goals of the program. Each of theseprograms can be designed for performance over a fixed period of time ora boundless amount of time. For example, a user can select a fitnessprogram designed as a 90 day challenge or select a stress reductionprogram or alcohol addiction recovery for performance on a daily basisuntil the user chooses to stop the program.

Similar to routine builder component 406 which facilitates building of acustom fitness routine by a user (or supervisor of the user), programbuilder component 904 facilitates designing a custom program. In anaspect, a user can select a preconfigured program and change certainvariables/requirements of the program to fit the user's needs. In otheraspects program builder component 904 can allow a user (or a supervisorof the user) to build a custom program from scratch. For example, a usercan set a schedule the user would like to adhere to, defining what theuser should do and when and how the user should respond to certainscenarios.

In another aspect, program builder component 904 can automatically adapta preconfigured program to fit the user's needs based on profileinformation for the user (e.g., user preferences, user health history,user physical abilities, user habits etc.) or program builder component904 can build a custom program (e.g., from scratch) for a user based onthe user's goals and other profile information for the user (e.g.,preferences, demographics, location, language, user, budgetaryconstraints, habits, health history, physical appearance andmeasurements, dietary restrictions, medications, schedule, and/orhistorical performance information (regarding past programs, routines,or activities tracked via avatar guidance system 200)). For example, auser can state that her goal is to lose 10 pounds in one month. Based onvarious information about the user's preferences (e.g., what foods theuser likes/dislikes, what types of physical exercise the userlikes/dislikes, how much and when the user likes to work out, etc.),demographics, location, language, user, budgetary constraints, habits,health history, physical appearance and measurements, dietaryrestrictions, medications, schedule, and/or historical performanceinformation, program builder component 904 can generate a custom healthand fitness program that is designed to cause the user to achieve hergoal if followed properly. Program builder component 904 can also employroutine builder component 906 to facilitate generating custom fitnessroutines to include in a health and fitness program.

In an aspect, the user can analyze the custom program and provide inputregarding modifications to the program. For example, a health andfitness program output by program builder component 904 could includesome requirements that the user would like to change. According to thisexample, the program could require the user to work out 5 days a weekwhen the user would prefer to work out 4 days a week. Based on inputrequesting the program to be modified to working out 4 days a week,program builder component 904 can automatically adjust otherrequirements of the program to maintain the user's goal. For example,program builder component 904 could adjust the intensity of the workoutsand/or modify her diet to account for the lost workout day. In otheraspect, program builder component 904 can request specific user input tofacilitate creating a custom program for the user. For example,depending on the type of program and the user's goal, program buildercomponent 904 can have the user fill out a form (e.g., or otherwiseprovide input) with answers to a specific set predetermined questionsassociated with the creation of the type of program. The user's answerscan be used to create/customize the program for the user.

In an aspect, in association with generation of a custom health andfitness program for a user, the user can provide program builder 904with an image of the user and/or avatar guidance platform 202 canreceive captured image data of the user (e.g., via visual capture device110). For example, two or three-dimensional image data can be capturedand received for a user. The captured image data can be provided toavatar guidance platform 202 in the form of a two or three dimensionalvisual replica/representation of the user or avatar guidance platform202 can employ the captured image data to generate a be a visualreplica/representation of the user (e.g., a two or three-dimensionalavatar representation of the user). In addition to image data, physicalmeasurements (e.g., regarding user height, weight, dimensions of bodyparts, BMI, etc.) can be received for the user and/or detected via theimage data. This measurement data can facilitate generation of a two orthree dimensional visual representation of the user.

According to this aspect, the user can provide input regardingcharacteristics of body features that the user would like to change andhow the user would like them to change using the image of the userand/or the visual representation of the user. For example, the usercould circle or target certain body parts and indicate how the userwould like them to change. According to this example, the user couldpoint to her stomach and indicate she would like to trim off inches fromher waist or develop a six pack. In another example, the user couldpoint to her arms and indicate she would like to increase the diameterof her biceps. In an aspect, this input can be received from the user bydirectly allowing the user to draw on/mark up the image/visualrepresentation of the user. For example, the user could place lines ormarks on parts of the users body indicating how the user would like thebody parts to appear.

Based on received input indicating characteristics of body features thatthe user would like to change and how the user would like them to changebased on user input regarding an image or visual replica of the user,user profile information, and any other user input regardingrequirements for the program, (e.g., duration of the program,preferences for the program, exercises and foods the you would likeincluded/excluded from the program, etc.), program builder component 904can design a custom diet and/or exercise program for the user. Thecustom diet and exercise program is specifically tailored to achieve theuser's goals (e.g., the changes to the user's physical appearance aspointed on by the user with respect to an image or visual representationof the user).

In another aspect, in association with generation of a custom health andfitness program for a user, the user can provide program builder 904with an image or visual representation of physical features the userdesires. For example, the user could provide program builder component904 with a picture of an athlete and request to have a program designedfor the of the user that will cause the user to look like the athlete.In an another example, the user could provide program builder component904 with an image of a supermodel and indicate that she would like totransform her body to look like the supermodel. In another example, theuser could provide program builder component 904 with a picture of aspecific body part and request a program that would help the usertransform his or her corresponding body part to appear like that in thepicture. For example, the user can provide program builder component 904with an image of a person's shoulders and indicate he would like hisshoulder to look like the picture.

According to this aspect, based on received input indicatingcharacteristics of body features that the user would like to have basedon image data representing those characteristics, user profileinformation, and any other user input regarding requirements for theprogram, (e.g., duration of the program, preferences for the program,exercises and foods the you would like included/excluded from theprogram, etc.), program builder component 904 can design a custom dietand/or exercise program for the user. The custom diet and exerciseprogram is specifically tailored to achieve the user's goals (e.g., thechanges to the user's body features to have the characteristics of thoseprovided in the image data.

Similar to avatar customization component 410, Avatar customizationcomponent 906 can provide for customizing the appearance and personalityof an avatar selected by the user to guide the user through a program.For example, the user can choose the gender, age, ethnicity, language,clothing, voice, and personality of their avatar. The user can alsochoose an avatar from a database of preconfigured avatar's havingvarious appearances and personalities. In an aspect, the avatar canembody a persona selected by the user, such as the user's conscience(e.g., the voice of reasoning or angel on the user's shoulder), theuser's friend, the user's mother, the user's coach/trainer, the user'sdoctor, the user's therapist, etc. In another aspect, the user canselected multiple avatar's to help guide the user with different aspectsof a program. For example, with respect to a diet and exercise program,the user can select a first avatar to facilitate adherence to aspects ofthe program related to the user's diet and a second avatar to facilitateaspects of the program related to the user's exercise.

Similar to routine adaptation component 412, program adaptationcomponent 908 can facilitate dynamically adapting aspects andrequirements of a program during the course of the program. Programadaptation component 908 can adapt aspects and requirements of a programbased on a variety of aspects including but not limited to: userphysical and physiological activity data and context data, referencedata for the user physical and physiological activity data and contextdata for the program, and user profile information (e.g., userpreferences, user goals, past performance history, etc.). For example,program adaptation component 908 can adjust and/or dynamically determinenew or modified requirements of a program based on a determination thatthe requirements are too difficult or too easy because the user isconsistently not meeting or exceeding the requirements of the program,respectively.

In another example, program adaptation component 908 can analyze a user′history of performance with respect to adherence to a program anddynamically adapt the requirements of the program to account for theuser's past performance. For example, where a user ran an extra 5.0miles on the workout the day before, program adaptation component 908and/or routine adaptation component 412 can change the requirements oftoday's workout to account for the extra 5.0 miles from the day before.For example, where today's workout was supposed to be a longer run,program adaptation component can determine that the user's goals (e.g.,to get in shape for an upcoming race) would be better suited if theworkout today was switch to yoga (e.g., to prevent injury due to overexercise). In another example, program adaptation component 908 canadapt current requirements of a user's program based on how the user isfeeling (e.g., sore, sick, energized, sad, tired, etc.), an amount ofsleep received, an amount of activity of the user that day/week, anamount of stress the user is experiencing, what the user's currentphysiological state is, what the user's current context is, what theuser ate that day (e.g., ate an extra number of calories, earn an extranumber of jumping jacks), unexpected changes to the user's schedule,unexpected injuries, events in the user's life, how the user isprogressing in the program, resources available to the user (e.g., groupmeetings, therapy, exercise equipment, food options, etc.

In another example, program adaptation component 908 is configured toregularly (e.g., once an hour, twice a day, once a day, once a week,etc.) evaluate a user's progress through a program in view of the user'sgoals and determine whether and how to adapt the requirements of theprogram based on the user's progress. For example, when a user's ishoping to lose X amount of weight and the user is not on target toachieve this goal if the user adheres to the current requirements of theprogram for the remainder of the program, program adaptation component908 can adjust the dietary and/or exercise requirements of the programto ensure the user will achieve her goal.

Similar to reporting component 416, reporting component 910 can sendinformation regarding a user's performance of a program in real-time orsubstantially real-time to another entity (e.g., another user, anothersystem) for interpretation thereof. For example, with respect to drugrehabilitation program, reporting component 910 can send informationregarding a user's adherence or deviation from the program to the user'stherapist in real-time. In another example, with respect to a diet andexercise program, reporting component can send information regarding theuser's performance of the program to the user's real life (e.g., human)trainer in real-time.

In view of the example systems and interfaces described herein, examplemethods that can be implemented in accordance with the disclosed subjectmatter can be further appreciated with reference to flowcharts in FIGS.10-12. For purposes of simplicity of explanation, example methodsdisclosed herein are presented and described as a series of acts;however, it is to be understood and appreciated that the disclosedsubject matter is not limited by the order of acts, as some acts mayoccur in different orders and/or concurrently with other acts from thatshown and described herein. For example, a method disclosed herein couldalternatively be represented as a series of interrelated states orevents, such as in a state diagram. Moreover, interaction diagram(s) mayrepresent methods in accordance with the disclosed subject matter whendisparate entities enact disparate portions of the methods. Furthermore,not all illustrated acts may be required to implement a method inaccordance with the subject specification. It should be furtherappreciated that the methods disclosed throughout the subjectspecification are capable of being stored on an article of manufactureto facilitate transporting and transferring such methods to computersfor execution by a processor or for storage in a memory.

FIG. 10 illustrates a flow chart of an example method 1000 forgenerating a personalized avatar that is responsive to a user's physicalstate and context, in accordance with various aspects and embodimentsdescribed herein. At 1002, information about a user is received duringperformance of a physical routine by the user (e.g., via receptioncomponent 204). The information includes physiological information andanatomical movement information. For example, as a user performs aworkout routine or a particular sports activity, information regardingthe user's heart rate, blood pressure, perspiration, cortisol level,glucose level, etc. can be received. In addition, information regardingwhat movements the user is performing, how the user's body is positionedduring the movement and intensity of the movement can be received. At1004, it is then determined whether and how the user deviates fromrequirements of the physical routine based on comparison of theinformation to reference physical and physiological activity metrics forthe physical routine (e.g., by analysis component 212). For example,analysis component can determine that the user's physiological stateindicates that the user does not comply with what the user'sphysiological state should be for a particular exercise of the physicalroutine. In another example, analysis component can determine that theuser's body position during a particular exercise yoga exercise is ontarget or not on target with how it should be.

At 1006, a response is determined for performance by avatar displayed tothe user, based on and in response to, a determination regarding whetherand how the user deviates from the requirements of the physical routine(e.g., via reaction component 214). The response is configured tofacilitate adherence to the requirements of the physical routine. Forexample reaction component 214 can determine a response that includesprovision of spoken instruction and physical demonstration by the avatarregarding an action for the user to perform that corrects a deviation.According to this example, where the user's pace and intensity of anexercise move is below the required level, the avatar response caninclude act of performance of the exercise move at the requiredintensity level with exclamatory words of encouragement spoken in anenthusiastic tone telling the user to “pick up the pace, let's go let'sgo!” Once the user corrects the deviation, the avatar's behavior canchange accordingly (e.g., the avatar can go back to evaluating theexercise as opposed to demonstrating, and the avatar can congratulatethe user for adhering to the requirements of the fitness routine). At1008, manifestation of the response is initiated, in response to thedetermination thereof, by the avatar as displayed to the user during theperformance of the physical routine (e.g., by the avatar controlcomponent 208, and the avatar generation component 226). In other words,the avatar presented to the user is caused to perform the response.

FIG. 11 illustrates a flow chart of another example method 1100 forgenerating a personalized avatar that is responsive to a user's physicalstate and context, in accordance with various aspects and embodimentsdescribed herein. At 1102, information about a user is received duringperformance of a physical routine by the user (e.g., via receptioncomponent 204). The information includes physiological information andanatomical movement information. For example, as a user performs aworkout routine or a particular sports activity, information regardingthe user's heart rate, blood pressure, perspiration, cortisol level,glucose level, etc. can be received. In addition, information regardingwhat movements the user is performing, how the user's body is positionedduring the movement and intensity of the movement can be received. At1104, it is then determined that the user's performance deviates fromphysical and physiological activity requirements for the physicalroutine based on comparison of the information to reference physical andphysiological activity metrics for the physical routine (e.g., byanalysis component 212). For example, analysis component can determinethat the user's physiological state indicates that the user isconsistently (with respect to a deviation frequency threshold) fallingbelow physical intensity requirements for the routine (e.g., based onheart rate, perspiration, fatigue, range of motion, etc.).

At 1106, a modification to the physical routine is determined during theperformance of the physical routine by the user based on how the userdeviates from the physical routine (e.g., by routine adaptationcomponent 412). For example, the routine adaptation component candetermine that the user should change the required exercises to aneasier option. At 1108, a response for performance by an avatardisplayed to the user is determined that informs the user regarding themodifications and informs the user how to perform the physical routinebased on the modification (e.g., via reaction component 214). Theresponse is configured to facilitate adherence to new requirements ofthe modified physical routine. At 1118, manifestation of the response bythe avatar is initiated in response to the determination thereof, by theavatar as displayed to the user during the performance of the physicalroutine (e.g., by the avatar control component 208, and the avatargeneration component 226).

FIG. 12 illustrates a flow chart of another example method 1200 forgenerating a personalized avatar that is responsive to a user's physicalstate and context, in accordance with various aspects and embodimentsdescribed herein. At 1202, a graphical user interface is generated thatincludes an avatar configured to react to a user during performance of aphysical routine by the user in response to a determination that theuser deviates from a physical requirement of the routine based onanalysis of biometric and movement data about the user generated duringperformance of the physical routine (e.g., via interface component 206).At 1202, the avatar is caused/directed to perform a reaction thatprovides instruction to correct the manner in which the user deviatesfrom the physical routine in response to reception of control commandsdefining the reaction, wherein the reaction comprises at least one ofspeech or movement (e.g., via avatar generation component 226). At 1206,the graphical user interface is displayed to the user with the avatarperforming the response (e.g., via rendering component 226).

IV—Example Avatar Visualization System

In one or more aspects, a system is provided that includes a receptioncomponent configured to receive information corresponding to a user'sphysical appearance and physical health, an analysis componentconfigured to determine or infer one or more changes to the user'sphysical appearance based on predicted performance of a health andfitness program by the user and the user's physical health, and avisualization component is configured to generate a visualrepresentation of the user based on the information and the one or morechanges to the user's physical appearance.

In another aspect, a method is disclosed that includes receivinginformation corresponding to a user's physical appearance and physicalhealth, predicting one or more changes to the user's physical appearancebased on predicted performance of a health and fitness program by theuser and the user's physical health, and generating a visualrepresentation of the user based on the information and the one or morechanges to the user's physical appearance.

In yet another aspect, a method is provided that includes using aprocessor to execute the computer executable instructions stored in amemory to perform the various acts. These acts include receivinginformation corresponding to a user's physical appearance and physicalhealth, predicting one or more changes to the user's physical appearancebased on predicted performance of a health and fitness program by theuser and the user's physical health, generating a visual representationof the user based on the information and the one or more changes to theuser's physical appearance, and displaying the visual representation viaa graphical user interface.

FIG. 13 presents an example avatar visualization system 1300 thatfacilitates visualizing how the user will appear in response to adheringto a health and fitness program in accordance with various aspects andembodiments described herein. System 1300 can include same or similarfeatures and functionalities as system 100. In an aspect, system 1300employs the architecture of system 100, including one or more of thevarious components/devices of system 100, wherein avatar visualizationplatform 1302 corresponds to avatar platform 114. Avatar visualizationplatform 1302 can thus include same or similar features andfunctionalities as avatar platform 114. Repetitive description of likeelements employed in respective embodiments of systems and interfacesdescribed herein are omitted for sake of brevity.

Avatar visualization system 1300 can include avatar visualizationplatform 1302, input 1322, rendering component 1324 and one or moreremote sources/systems 1326. Input 1322, rendering component 1324 andthe one or more remote sources/systems 1326 can respectively correspondto input 234, rendering component 236 and one or more remotesources/systems 238 discussed with respect to FIG. 2. Avatarvisualization platform 1302 is configured to generate a visualrepresentation or replica (e.g., an avatar) of a user based on receivedappearance information for the user, received appearance data for theuser, and known health information for the user (including physicalcharacteristics of the user and physiological characteristics of theuser). In particular, avatar visualization platform 1302 can generate anavatar that is a visual replica of the user as the user currentlyappears. Accordingly, as the user's appearance changes over the courseof performance of a health and fitness program, the appearance of theavatar can also change to provide a mirrored visualization of thechanges in the user. For example, each new day of the program, theappearance of the user can be evaluated, captured and imparted to theavatar. Thus in essence, the user's avatar can resemble a mirror imageof himself over the course of a program.

Avatar visualization platform 1302 is further configured to generate avisual representation of the user that is a prediction of how the userwill appear at a future point in time based on performance of a healthand fitness program by the user. For example, the user can select,(and/or design, or otherwise be assigned) a specific health and fitnessprogram for performance using fitness module 1302 (wherein fitnessmodule 1302 can include same or similar features and functionalities offitness module 230). Using avatar visualization platform 1302, the usercan be provided a visual representation that demonstrates how the willpredicatively look after performance/completion of the program if theuser adheres to the requirements of the program. In addition, the usercan select various time points in the program (e.g., after week 1, afterweek 2, after week 3, etc.) and avatar visualization platform 1302 cangenerate a visual representation of the user that demonstrates how theuser will predicatively look at the respective time points if the useradheres to the requirements of the program.

This feature of avatar visualization platform 1302 allows a user todynamically pick and choose different health and fitness programs and/orchange different variables of a health and fitness program and see howthe user would appear in the future based on the selected health andfitness program and/or the different variables. Accordingly, a user canselect a health and fitness program that will cause the user to achievean optimally desired appearance. For example, as the user selectsdifferent health and fitness programs and/or can changes variables of aselected health and fitness program, avatar visualization platform 1302can dynamically adapt the appearance of an avatar presented to the userthat corresponds to a predicted visualization of how the user willappear based on completion and adherence to the different health andfitness or the health and fitness program with the respectively chosenvariables. As a result, the user can select the a health and fitnessprogram based on how it will affect the user's appearance.

In an aspect, the avatar is generated and presented to the user via arendering component 1324 located at a client device (e.g., client device106). Rendering component 1324 can include suitable hardware (e.g., adisplay screen, a hologram generation device, etc.) and software (e.g.,software for generating a GUI and/or software for accessing andrendering network based interface, such a browser) to accomplishgenerating and presenting an avatar. Generally, avatar visualizationplatform 1302 can include memory 1312 that stores computer executablecomponents and processor 1322 that executes the computer executablecomponents stored in the memory, examples of which can be found withreference to FIG. 17.

It is to be appreciated that although avatar guidance visualizationplatform 1302 is illustrated as being a standalone component, suchimplementation is not so limited. For example, avatar visualizationplatform 1302 can be located at a client device (e.g., client device106), a remote server (e.g., avatar server 116) or the cloud. In anotheraspect, one or more components of avatar visualization platform 1302 canbe located at both the client device and the remote server. In yetanother aspect, the components of avatar guidance platform can bedistributed between the client and the server. Still in yet anotheraspect, avatar visualization platform 1302 can be included within avatarguidance platform 202, or vice versa. All or portions of avatarvisualization platform 1302 can be can be operatively coupled to all orportions of avatar guidance platform 202, or vice versa. Moreover,avatar visualization platform 1302 can be can be granted access to allor portions of avatar guidance platform 202, or vice versa.

Avatar visualization platform 1302 can include reception component 1302,processing module 1306, interface component 1316, visualizationcomponent 1318 and program guide module 1320. Reception component 1302is configured to receive various inputs 1322 including the data notedwith respect to input 234. In accordance with aspects of avatarvisualization platform 1302, input 1322 particularly includes a varietyof information about the user's physical health and appearance. In anaspect, this physical health and/or appearance information is providedby the user (or another user such as the user's medical caregiver ortherapist) or extracted from a remote system/source (e.g., electronicmedical/health records for the user provided by a medical institution).In another aspect, physical health and/or appearance information for auser is captured via various sensing devices 106 worn by or otherwiseattached to the user, intelligent fitness device(s) employed by the user(e.g., intelligent fitness devices 118), other remote medical/sensingequipment employed by the user (e.g., a heart monitor, a scale, etc.),and/or a visual capture device (e.g., visual capture device 110) pointedat the user. In an aspect, health and/or appearance information isreceived by reception component 1304 during a capture process prior togeneration of a visual replica of the user. In another aspect, thisphysical health and/or appearance data can be received for the user inreal-time as the user performs a fitness routine or health and fitnessprogram.

In an aspect, physical health and appearance information received for auser is stored by avatar visualization platform 1302 in association witha user profile established for the user (e.g., user profile data 1314).User profile data 1314 can also include the various profile informationdescribed with respect to user profile data 222. For example, a user canestablish a profile with avatar visualization platform 1302 thatincludes information defining the user's preferences (e.g., diet andexercises preferences), health information, demographics and schedule.The profile can also include a logged history of captured physical andphysiological activity data for the user over the course of performanceof various fitness and/or other programs by the user (e.g., using avatarguidance platform 202), and other logged/monitored information for theuser (e.g., habits, food and drink consumption, activities levels, sleeppatterns, etc.).

Physical health information for a user can include any informationregarding a user's mental and physical health. For example, physicalhealth information can include but is not limited to: physicalmeasurements (e.g., height, weight, BMI) of the user, physical andphysiological conditions effecting the user, mental illness, any past orcurrent physical injuries affecting the user, surgeries received by theuser, history of medical conditions associated with the user and theuser's relatives, any medications taken by the user, and tobacco andalcohol consumption of the user etc. Health information can also includeinformation related to physiological indicators/measures that arecapable of being determined for a user using various know clinicallaboratory tests, including information related to the user's geneticmake-up, protein levels, hormone levels, blood type, white/red bloodcell count, metabolism, etc. Health information can also includeinformation regarding physical fitness practices and abilities of theuser (e.g., how fast the user can run, how high the user can jump, howmuch weight the user can lift, flexibility of the user, range of motionof the user, etc.).

Appearance information for a user includes two or three-dimensionalimage data captured/taken of the user. For example, the user can haveimage data taken of himself or herself (e.g., a picture, a video, aseries of three-dimensional image data captures of the user fromdifferent camera perspectives relative to the user, etc.) as the userstands still and/or as the user performs various test/model movements(e.g., using a visual capture device 110). At this time, data regardingthe user's physiological state can also be captured by various medicaldevices or biometric sensing devices (e.g., devices 106) and received byreception component 1304. For example, the physiological data capturedand provided to reception component 1304 (e.g., via a wired or wirelessconnection) can include information regarding the user's blood pressure,perspiration, respiration, white blood cell count, temperature, glucoselevel, drugs present in the body, antigens present in the body, etc.Other example data that can be captured and reported by asensing/medical device can include information indicating the user'sphysical measurements (e.g., height, weight, BMI, etc.).

In an aspect, image data captured for a user is used to generate avisual representation of the user corresponding to the user's currentappearance. In one aspect, the visual capture device employed to capturethe image data (e.g., visual capture device 110) can generate thisvisual representation. In another aspect, the visual capture device canprovide the captured image data to reception component 1304 andvisualization component 1318 can employ the image data to generate thethree dimensional representation of the user as the user currentlyappears. For example, visualization component 1318 can generate anavatar that resembles the current appearance of the user. Interfacecomponent 1316 is configured to generate a graphical user interface thatincludes the avatar. In an aspect, interface component 1316 can includesame or similar functionalities as interface component 206. An interfaceincluding an avatar generated by visualization component 1318 is furtherpresented to the user via rendering component 1324.

In an aspect, an avatar generated by visualization component 1318 canfurther be configured to exhibit the various features andfunctionalities of avatars discussed herein. For example, an avatargenerated by visualization component 1318 that resembles the appearanceof a user can function as the user's guide or coach in association withperformance of a monitored program, routine or activity, as discussedwith respect to avatar guidance system 200.

In addition to generating an avatar that resembles a user's currentappearance. Visualization component 1318 is further configured togenerate a visual representation of the user that is a prediction of howthe user will appear at a future point in time based on performance of ahealth and fitness program by the user. In particular, processing module1306 is configured to analyze received input regarding a user's currentappearance and determine or infer how the user's appearance will changein response to performance of specific health and fitness program basedon the user′ current physical appearance, the user's health information(as included in the user's profile), other profile information for theuser (e.g., age, gender, ethnicity, etc.), and the requirements of thehealth and fitness routine.

For example analysis component 1308 can employ information relatingdifferent diet and exercise program, and/or features of the respectiveprograms to measurable appearance metrics including but not limited to:to weight loss, weight gain, fat loss, fat gain, dimensions of bodyparts, and muscle definition/appearance, with respect to individualhuman body parts and/or the human body as a whole. Analysis component1308 can further adjust these appearance metrics to account for specifichealth information for the user (e.g., physical measurements, physicalconditions, surgeries received, medications taken, dietary restrictions,metabolism, and other health information), along with informationregarding the user's age, gender, ethnicity, and/or any other personalinformation that can have an effect on a user's body appearance andfunction. For example, the manner in which a specific diet and exerciseregimen changes the amount of inches lost and muscle definitionestablished with respect to a user's abdominal area can depend on theuser's health profile, age and gender.

Analysis component 1308 can thus determine how a particular user's bodyand appearance will likely change based on a specific diet and/orexercise regimen. Based on these determined changes, visualizationcomponent 1318 can generate a visual representation of the user thatdepicts how the user will look following performance of the specificdiet and/or exercise regimen. In an aspect, visualization component 1318can modify current image data of a user to account for the changesdetermined by analysis component 1308. For example, visualizationcomponent 1318 can generate an avatar depicting the user as the usercurrently appears and morph the avatar's appearance, based on thechanges determined by analysis component 1308, to generate a new visualrepresentation of the user depicting how the user will appear afterperformance of the diet and exercise regimen.

In some aspects, analysis component 1308 can specifically determine howa user's body will change at different points over the course of ahealth and fitness program. According to this aspect, a user can requestto see a visualization of how he or she will appear at any point duringthe health and fitness program. For example, when a user has selected a90 day program, before beginning the program, the user can be providedwith a visualization of how he or she would look after completion of theprogram. The user could also request to see how he or she would look onday 10, on day 32, on day 45, etc., and visualization component can 1318generate the respective visual representations of the user. According tothis aspect, analysis component 1308 can determine how a user'sappearance will change based on analysis of the user's currentappearance, health information, and age/gender in view of what will beperformed by the user (e.g., diet and exercise wise), over the durationof time from the initiation of the program to the selected time marker.

In an aspect, analysis component 1308 can employ inference component tofacilitate inferring how the user's appearance will change in responseto performance of the specific health and fitness program based on theuser′ current physical appearance, the user's health information, andthe requirements of the health and fitness routine. Inference component1310 can include same or similar features and functionalities asinference component 216. In an aspect, inference component 1308 analyzeappearance information for a plurality of user's regarding howperformance of different health and fitness routines and regimeseffected changes in their appearance in view of respective healthinformation (e.g., starting height, weight, BMI, age, ethnicity,medications taken, physical conditions, physical abilities, etc.) forthe different users. Inference component 1308 can further employ variousmachine learning techniques to optimize determinations regarding how aspecific user's appearance will be affected by different health andfitness programs (e.g., including specific diet and fitness requirementsof the different health and fitness programs).

For example, inference component 1308 can analyze historical performanceand appearance information for a set of users having a similar healthprofile, age and gender as a current user. Inference component 1308 canthen determine how performance of these different health and fitnessprograms actually effected changes their respective appearance andemploy this information to infer how performance of the different healthand fitness routines will affect the current user's appearance. In anaspect, visualization component 1318 present a user with example imagesof before and after visualizations/pictures taken of other user's whoperformed the different health and fitness programs.

Avatar visualization platform 1302 can also include program guide module1320. Program guide module 1320 can include same or similarfunctionality as program guide module 232. In particular, program guidemodule 1320 can include program selection component 902, a programbuilder component 904. Using these respective components, a user canselect or design a specific health and fitness program. The programbuilder component 904 can also employ various features of fitness module230 (e.g., routine selection component 404, routine builder component406, etc.) to facilitate selecting or designing specific fitnessroutines/activities for inclusion in a health and fitness program. Therequirements of a fitness program selected/designed by the user can varybut can generally relate to dietary requirements, fitness requirements,and a duration of the program. Based on the health and fitness programselected or designed by the user, visualization component 1318 cangenerate a representation of the user as the user will appear inresponse to performance of the program. Accordingly, a user can employavatar visualization component 1318 in conjunction with fitness module1320 to facilitate selecting/designing a health and fitness program thatwill bring about desired changes in the user's appearance.

FIG. 14 presents another example avatar visualization system 1400 thatfacilitates visualizing how the user will appear in response to adheringto a health and fitness program in accordance with various aspects andembodiments described herein. System 1400 can include same or similarfeatures and functionalities as system 1300, with the addition ofrequest component 1404 and risk component 1406 and regulation component140 to program guide module 1320. Repetitive description of likeelements employed in respective embodiments of systems and interfacesdescribed herein are omitted for sake of brevity.

Avatar visualization platform 1402 is configured to facilitate designinga health and fitness program to achieve a desired visual appearance ofthe user. In an aspect, a user can provide a request via requestcomponent 1404 that includes information identifying one or morecharacteristics of the user's body that the user would like to achieve.Based on the request, the user's current appearance, and the user'shealth and physical/physiological state information, program guidemodule 1320 (e.g., via program builder component 904), can generate apersonalized diet and exercise program for the user that is designed tocause the user's appearance to changed in the requested manner.

For example, the user could submit a request via request component 1404indicating how she would like her stomach to appear, her hips to appear,her thighs to appear, etc. The request can also indicate how much theweight the user would like to lose or gain and/or how much muscle theuser would like to lose or gain. In another example, the request caninclude information regarding muscle toning. The request can alsoprovide a timeline for when the use user would like to achieve thechanges to the user's appearance.

In an aspect, in order to identify physical characteristics the userwould like to obtain using a health and fitness plan, the user cancritique an image of himself or herself or avatar generated byvisualization component 1318 that represents the user's appearance. Forexample, visualization component 1318 can generate an avatar that ispresented to the user and represents the user's current appearance.Using the visualization, the user can point out various aspects of theuser's physical features that the user would like to change and how theuser would like to change them. For example, the user could indicate(e.g., by drawing on or marking up the avatar representation) where theuser would like to gain muscle and how much muscle the user would liketo gain. In another example, the user could mark places on his or herbody whether he or she would like to trim fat or tone up.

In another aspect, in order to identify physical characteristics theuser would like to obtain using a health and fitness plan, the userprovide an image of a person's body that the user's would like his orher body to resemble, or a particular body part that the user would likehave his or her corresponding body part resemble. For example, inassociation with a request for a custom diet and fitness plan, the usercan provide an image of himself or herself when they were in great shapeyears prior or a picture of a famous fitness model. In another example,the user could provide an image of a set of abdominals that the userwould like his or her abdominals to look like.

In some respects, a user's aspirations may be unachievable or unhealthy.For example, a user may request he or she would like to appear a certainway within a period of two weeks and this request would require loosingof an unhealthy amount of weight too quickly. Accordingly, program guidemodule 1320 can include risk component 1406 and regulation component1408. Risk component 1406 is configured to evaluate a request anddetermine health risks associated with achieving the one or more desiredchanges to the user's physical appearance identified in the requestbased on the user's current appearance and health, profile informationfor the user and various existing health standards. In an aspect, when arequest provides a duration of time over which the user would like toachieve the physical changes, risk component 1406 can also considerwhether the user's aspirations are reasonable and/or achievable in ahealthy manner within the duration of time.

Based on the health risks identified or determined by risk component1406 regulation component 1408 is configured to determine whether theuser's goal is obtainable in a healthy and safe manner (e.g., based onvarious health standards and risk allowance thresholds). For example,regulation component 1408 can return a response to a user's requestindicating that the user's goal is or is not possible over the desiredduration in a healthy manner and/or that the user's goal is not arecommended healthy goal (e.g., based on various existing healthstandards). For example, the user may desire to achieve a weight that isunhealthy for the user's height, age, and/or physical training routine(e.g., where the user is an athlete required to perform various physicalactivities). In an aspect, regulation component 1408 can automaticallyadjust aspects of a user's request to accommodate risks identified byrisk component 1406. For example, regulation component 1408 can increasethe duration of time of a health and fitness program to a duration thatallows the user to achieve his or her goal in a reasonable manner. Inanother example, regulation component 1408 can slightly modify physicalthe degree of physical changes (e.g., the amount of weight lost/gained)request by the user to a reasonable value.

FIG. 15 illustrates a flow chart of an example method 1500 forgenerating a visualization representing how a user will appear inresponse to adhering to a health and fitness program, in accordance withvarious aspects and embodiments described herein. At 1502, informationcorresponding to a user's physical appearance and physical health isreceived (e.g., via reception component 1304). At 1504, one or morechanges to the user's physical appearance are predicted based onpredicted performance of a health and fitness program by the user andthe user's physical health (e.g., via processing module 1306). At 1506,a visual representation of the user is generated based on theinformation and the one or more changes to the user's physicalappearance (e.g., via visualization component 1318).

FIG. 16 illustrates a flow chart of another example method 1600 forgenerating a visualization representing how a user will appear inresponse to adhering to a health and fitness program, in accordance withvarious aspects and embodiments described herein. At 1602, informationcorresponding to a user's physical appearance, physical health anddemographic profile is received (e.g., via reception component 1304). At1604, a request is received for a health and fitness program, therequest identifying one or more physical characteristics the user wouldlike to obtain via the health and fitness program (e.g., via requestcomponent 1402). At 1606, the health and fitness program is generatedbased on the one or more characteristics and the information (e.g., viaprogram guide module 1320). At 1608, one or more changes to the user'sphysical appearance are predicted based on predicted performance of ahealth and fitness program by the user and the user's physical health(e.g., via processing module 1306). At 1610, a visual representation ofthe user is generated based on the information and the one or morechanges to the user's physical appearance (e.g., via visualizationcomponent 1318).

V—Example Operating Environments

The systems and processes described below can be embodied withinhardware, such as a single integrated circuit (IC) chip, multiple ICs,an application specific integrated circuit (ASIC), or the like. Further,the order in which some or all of the process blocks appear in eachprocess should not be deemed limiting. Rather, it should be understoodthat some of the process blocks can be executed in a variety of orders,not all of which may be explicitly illustrated in this disclosure.

With reference to FIG. 17, a suitable environment 1700 for implementingvarious aspects of the claimed subject matter includes a computer 1702.The computer 1702 includes a processing unit 1704, a system memory 1706,a codec 1705, and a system bus 1708. The system bus 1708 couples systemcomponents including, but not limited to, the system memory 1706 to theprocessing unit 1704. The processing unit 1704 can be any of variousavailable processors. Dual microprocessors and other multiprocessorarchitectures also can be employed as the processing unit 1704.

The system bus 1708 can be any of several types of bus structure(s)including the memory bus or memory controller, a peripheral bus orexternal bus, and/or a local bus using any variety of available busarchitectures including, but not limited to, Industrial StandardArchitecture (ISA), Micro-Channel Architecture (MSA), Extended ISA(EISA), Intelligent Drive Electronics (IDE), VESA Local Bus (VLB),Peripheral Component Interconnect (PCI), Card Bus, Universal Serial Bus(USB), Advanced Graphics Port (AGP), Personal Computer Memory CardInternational Association bus (PCMCIA), Firewire (IEEE 104), and SmallComputer Systems Interface (SCSI).

The system memory 1706 includes volatile memory 10 and non-volatilememory 1712. The basic input/output system (BIOS), containing the basicroutines to transfer information between elements within the computer1702, such as during start-up, is stored in non-volatile memory 1712. Inaddition, according to present innovations, codec 1705 may include atleast one of an encoder or decoder, wherein the at least one of anencoder or decoder may consist of hardware, a combination of hardwareand software, or software. Although, codec 1705 is depicted as aseparate component, codec 1705 may be contained within non-volatilememory 1712. By way of illustration, and not limitation, non-volatilememory 1712 can include read only memory (ROM), programmable ROM (PROM),electrically programmable ROM (EPROM), electrically erasableprogrammable ROM (EEPROM), or flash memory. Volatile memory 10 includesrandom access memory (RAM), which acts as external cache memory.According to present aspects, the volatile memory may store the writeoperation retry logic (not shown in FIG. 17) and the like. By way ofillustration and not limitation, RAM is available in many forms such asstatic RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), doubledata rate SDRAM (DDR SDRAM), and enhanced SDRAM (ESDRAM.

Computer 1702 may also include removable/non-removable,volatile/non-volatile computer storage medium. FIG. 17 illustrates, forexample, disk storage 1711. Disk storage 1711 includes, but is notlimited to, devices like a magnetic disk drive, solid state disk (SSD)floppy disk drive, tape drive, Jaz drive, Zip drive, LS-70 drive, flashmemory card, or memory stick. In addition, disk storage 1711 can includestorage medium separately or in combination with other storage mediumincluding, but not limited to, an optical disk drive such as a compactdisk ROM device (CD-ROM), CD recordable drive (CD-R Drive), CDrewritable drive (CD-RW Drive) or a digital versatile disk ROM drive(DVD-ROM). To facilitate connection of the disk storage devices 1711 tothe system bus 1708, a removable or non-removable interface is typicallyused, such as interface 1716.

It is to be appreciated that FIG. 17 describes software that acts as anintermediary between users and the basic computer resources described inthe suitable operating environment 1700. Such software includes anoperating system 1718. Operating system 1718, which can be stored ondisk storage 1711, acts to control and allocate resources of thecomputer system 1702. Applications 1720 take advantage of the managementof resources by operating system 1718 through program modules 1724, andprogram data 1726, such as the boot/shutdown transaction table and thelike, stored either in system memory 1706 or on disk storage 1711. It isto be appreciated that the claimed subject matter can be implementedwith various operating systems or combinations of operating systems.

A user enters commands or information into the computer 1702 throughinput device(s) 1728. Input devices 1728 include, but are not limitedto, a pointing device such as a mouse, trackball, stylus, touch pad,keyboard, microphone, joystick, game pad, satellite dish, scanner, TVtuner card, digital camera, digital video camera, web camera, and thelike. These and other input devices connect to the processing unit 1704through the system bus 1708 via interface port(s) 1730. Interfaceport(s) 1730 include, for example, a serial port, a parallel port, agame port, and a universal serial bus (USB). Output device(s) 1736 usesome of the same type of ports as input device(s). Thus, for example, aUSB port may be used to provide input to computer 1702, and to outputinformation from computer 1702 to an output device 1736. Output adapter1734 is provided to illustrate that there are some output devices 1736like monitors, speakers, and printers, among other output devices 1736,which require special adapters. The output adapters 1734 include, by wayof illustration and not limitation, video and sound cards that provide ameans of connection between the output device 1736 and the system bus1708. It should be noted that other devices and/or systems of devicesprovide both input and output capabilities such as remote computer(s)1738.

Computer 1702 can operate in a networked environment using logicalconnections to one or more remote computers, such as remote computer(s)1738. The remote computer(s) 1738 can be a personal computer, a server,a router, a network PC, a workstation, a microprocessor based appliance,a peer device, a smart phone, a tablet, or other network node, andtypically includes many of the elements described relative to computer1702. For purposes of brevity, only a memory storage device 1740 isillustrated with remote computer(s) 1738. Remote computer(s) 1738 islogically connected to computer 1702 through a network interface 1742and then connected via communication connection(s) 1744. Networkinterface 1742 encompasses wire and/or wireless communication networkssuch as local-area networks (LAN) and wide-area networks (WAN) andcellular networks. LAN technologies include Fiber Distributed DataInterface (FDDI), Copper Distributed Data Interface (CDDI), Ethernet,Token Ring and the like. WAN technologies include, but are not limitedto, point-to-point links, circuit switching networks like IntegratedServices Digital Networks (ISDN) and variations thereon, packetswitching networks, and Digital Subscriber Lines (DSL).

Communication connection(s) 1744 refers to the hardware/softwareemployed to connect the network interface 1742 to the bus 1708. Whilecommunication connection 1744 is shown for illustrative clarity insidecomputer 1702, it can also be external to computer 1702. Thehardware/software necessary for connection to the network interface 1742includes, for exemplary purposes only, internal and externaltechnologies such as, modems including regular telephone grade modems,cable modems and DSL modems, ISDN adapters, and wired and wirelessEthernet cards, hubs, and routers.

Referring now to FIG. 18, there is illustrated a schematic block diagramof a computing environment 1800 in accordance with this disclosure. Thesystem 1800 includes one or more client(s) 1802 (e.g., laptops, smartphones, PDAs, media players, computers, portable electronic devices,tablets, and the like). The client(s) 1802 can be hardware and/orsoftware (e.g., threads, processes, computing devices). The system 1800also includes one or more server(s) 1804. The server(s) 1804 can also behardware or hardware in combination with software (e.g., threads,processes, computing devices). The servers 1804 can house threads toperform transformations by employing aspects of this disclosure, forexample. One possible communication between a client 1802 and a server1804 can be in the form of a data packet transmitted between two or morecomputer processes wherein the data packet may include video data. Thedata packet can include a metadata, e.g., associated contextualinformation, for example. The system 1800 includes a communicationframework 1806 (e.g., a global communication network such as theInternet, or mobile network(s)) that can be employed to facilitatecommunications between the client(s) 1802 and the server(s) 1804.

Communications can be facilitated via a wired (including optical fiber)and/or wireless technology. The client(s) 1802 include or areoperatively connected to one or more client data store(s) 1808 that canbe employed to store information local to the client(s) 1802 (e.g.,associated contextual information). Similarly, the server(s) 1804 areoperatively include or are operatively connected to one or more serverdata store(s) 1810 that can be employed to store information local tothe servers 1804.

In one embodiment, a client 1802 can transfer an encoded file, inaccordance with the disclosed subject matter, to server 1804. Server1804 can store the file, decode the file, or transmit the file toanother client 1802. It is to be appreciated, that a client 1802 canalso transfer uncompressed file to a server 1804 and server 1804 cancompress the file in accordance with the disclosed subject matter.Likewise, server 1804 can encode video information and transmit theinformation via communication framework 1806 to one or more clients1802.

The illustrated aspects of the disclosure may also be practiced indistributed computing environments where certain tasks are performed byremote processing devices that are linked through a communicationsnetwork. In a distributed computing environment, program modules can belocated in both local and remote memory storage devices.

Moreover, it is to be appreciated that various components described inthis description can include electrical circuit(s) that can includecomponents and circuitry elements of suitable value in order toimplement the embodiments of the subject innovation(s). Furthermore, itcan be appreciated that many of the various components can beimplemented on one or more integrated circuit (IC) chips. For example,in one embodiment, a set of components can be implemented in a single ICchip. In other embodiments, one or more of respective components arefabricated or implemented on separate IC chips.

What has been described above includes examples of the embodiments ofthe present invention. It is, of course, not possible to describe everyconceivable combination of components or methodologies for purposes ofdescribing the claimed subject matter, but it is to be appreciated thatmany further combinations and permutations of the subject innovation arepossible. Accordingly, the claimed subject matter is intended to embraceall such alterations, modifications, and variations that fall within thespirit and scope of the appended claims. Moreover, the above descriptionof illustrated embodiments of the subject disclosure, including what isdescribed in the Abstract, is not intended to be exhaustive or to limitthe disclosed embodiments to the precise forms disclosed. While specificembodiments and examples are described in this disclosure forillustrative purposes, various modifications are possible that areconsidered within the scope of such embodiments and examples, as thoseskilled in the relevant art can recognize.

In particular and in regard to the various functions performed by theabove described components, devices, circuits, systems and the like, theterms used to describe such components are intended to correspond,unless otherwise indicated, to any component which performs thespecified function of the described component (e.g., a functionalequivalent), even though not structurally equivalent to the disclosedstructure, which performs the function in the disclosure illustratedexemplary aspects of the claimed subject matter. In this regard, it willalso be recognized that the innovation includes a system as well as acomputer-readable storage medium having computer-executable instructionsfor performing the acts and/or events of the various methods of theclaimed subject matter.

The aforementioned systems/circuits/modules have been described withrespect to interaction between several components/blocks. It can beappreciated that such systems/circuits and components/blocks can includethose components or specified sub-components, some of the specifiedcomponents or sub-components, and/or additional components, andaccording to various permutations and combinations of the foregoing.Sub-components can also be implemented as components communicativelycoupled to other components rather than included within parentcomponents (hierarchical). Additionally, it should be noted that one ormore components may be combined into a single component providingaggregate functionality or divided into several separate sub-components,and any one or more middle layers, such as a management layer, may beprovided to communicatively couple to such sub-components in order toprovide integrated functionality. Any components described in thisdisclosure may also interact with one or more other components notspecifically described in this disclosure but known by those of skill inthe art.

In addition, while a particular feature of the subject innovation mayhave been disclosed with respect to only one of several implementations,such feature may be combined with one or more other features of theother implementations as may be desired and advantageous for any givenor particular application. Furthermore, to the extent that the terms“includes,” “including,” “has,” “contains,” variants thereof, and othersimilar words are used in either the detailed description or the claims,these terms are intended to be inclusive in a manner similar to the term“comprising” as an open transition word without precluding anyadditional or other elements.

As used in this application, the terms “component,” “module,” “system,”or the like are generally intended to refer to a computer-relatedentity, either hardware (e.g., a circuit), a combination of hardware andsoftware, software, or an entity related to an operational machine withone or more specific functionalities. For example, a component may be,but is not limited to being, a process running on a processor (e.g.,digital signal processor), a processor, an object, an executable, athread of execution, a program, and/or a computer. By way ofillustration, both an application running on a controller and thecontroller can be a component. One or more components may reside withina process and/or thread of execution and a component may be localized onone computer and/or distributed between two or more computers. Further,a “device” can come in the form of specially designed hardware;generalized hardware made specialized by the execution of softwarethereon that enables the hardware to perform specific function; softwarestored on a computer readable storage medium; software transmitted on acomputer readable transmission medium; or a combination thereof.

Moreover, the words “example” or “exemplary” are used in this disclosureto mean serving as an example, instance, or illustration. Any aspect ordesign described in this disclosure as “exemplary” is not necessarily tobe construed as preferred or advantageous over other aspects or designs.Rather, use of the words “example” or “exemplary” is intended to presentconcepts in a concrete fashion. As used in this application, the term“or” is intended to mean an inclusive “or” rather than an exclusive“or”. That is, unless specified otherwise, or clear from context, “Xemploys A or B” is intended to mean any of the natural inclusivepermutations. That is, if X employs A; X employs B; or X employs both Aand B, then “X employs A or B” is satisfied under any of the foregoinginstances. In addition, the articles “a” and “an” as used in thisapplication and the appended claims should generally be construed tomean “one or more” unless specified otherwise or clear from context tobe directed to a singular form.

Computing devices typically include a variety of media, which caninclude computer-readable storage media and/or communications media, inwhich these two terms are used in this description differently from oneanother as follows. Computer-readable storage media can be any availablestorage media that can be accessed by the computer, is typically of anon-transitory nature, and can include both volatile and nonvolatilemedia, removable and non-removable media. By way of example, and notlimitation, computer-readable storage media can be implemented inconnection with any method or technology for storage of information suchas computer-readable instructions, program modules, structured data, orunstructured data. Computer-readable storage media can include, but arenot limited to, RAM, ROM, EEPROM, flash memory or other memorytechnology, CD-ROM, digital versatile disk (DVD) or other optical diskstorage, magnetic cassettes, magnetic tape, magnetic disk storage orother magnetic storage devices, or other tangible and/or non-transitorymedia which can be used to store desired information. Computer-readablestorage media can be accessed by one or more local or remote computingdevices, e.g., via access requests, queries or other data retrievalprotocols, for a variety of operations with respect to the informationstored by the medium.

On the other hand, communications media typically embodycomputer-readable instructions, data structures, program modules orother structured or unstructured data in a data signal that can betransitory such as a modulated data signal, e.g., a carrier wave orother transport mechanism, and includes any information delivery ortransport media. The term “modulated data signal” or signals refers to asignal that has one or more of its characteristics set or changed insuch a manner as to encode information in one or more signals. By way ofexample, and not limitation, communication media include wired media,such as a wired network or direct-wired connection, and wireless mediasuch as acoustic, RF, infrared and other wireless media.

In view of the exemplary systems described above, methodologies that maybe implemented in accordance with the described subject matter will bebetter appreciated with reference to the flowcharts of the variousfigures. For simplicity of explanation, the methodologies are depictedand described as a series of acts. However, acts in accordance with thisdisclosure can occur in various orders and/or concurrently, and withother acts not presented and described in this disclosure. Furthermore,not all illustrated acts may be required to implement the methodologiesin accordance with certain aspects of this disclosure. In addition,those skilled in the art will understand and appreciate that themethodologies could alternatively be represented as a series ofinterrelated states via a state diagram or events. Additionally, itshould be appreciated that the methodologies disclosed in thisdisclosure are capable of being stored on an article of manufacture tofacilitate transporting and transferring such methodologies to computingdevices. The term article of manufacture, as used in this disclosure, isintended to encompass a computer program accessible from anycomputer-readable device or storage media.

1-20. (canceled)
 21. A system, comprising: a memory having storedthereon computer executable components; a processor that executes atleast the following computer executable components: an avatar renderingcomponent configured to generate an instructor avatar and present theinstructor avatar to two or more disparate users during concurrentperformance of a group fitness routine, wherein the instructor avatar isconfigured to facilitate performance of the group fitness routine by thetwo or more users; a reception component configured to receive first biofeedback from a first of the two or more users and second biofeedbackfrom a second user of the two or more users during the concurrentperformance of the group fitness routine; an analysis componentconfigured to evaluate performance of the group fitness routine by thefirst user based on comparison of the first biofeedback and the secondbiofeedback; and a reaction component configured to generate a reactionby the instructor avatar regarding an aspect of the performance of thegroup fitness routine by the first user based on the comparison.
 22. Thesystem of claim 21, wherein the reaction component generates a reactionby the instructor avatar to suggest a modification to the performance ofthe group fitness routine by the first user.
 23. The system of claim 21,wherein the analysis component is configured to determine a modificationto the aspect of the performance of the group fitness routine by thefirst user based on the comparison, and wherein the reaction comprisesverbal feedback instructing the first user regarding the modification.24. The system of claim 21, wherein the avatar rendering component isfurther configured to generate a first user avatar that corresponds tothe first bio feedback of the first user and a second user avatar thatcorresponds to the second bio feedback of the second user and generate avisualization of the first user avatar and the second user avatarrespectively performing the group fitness routine.
 25. The system ofclaim 21, wherein the two or more users are remote from one another andwherein the instructor avatar is presented at respective devices of thetwo or more users during the concurrent performance of the group fitnessroutine by the two or more users.
 26. The system of claim 21, whereinthe reaction component generates verbal and visual feedback from theinstructor avatar directed to the first user regarding the aspect of theperformance of the group fitness routine by the first user.
 27. Thesystem of claim 21, wherein the reaction component generates verbal andvisual feedback from the instructor avatar directed to one or more usersother than the first user regarding the aspect of the performance of thegroup fitness routing by the first user.
 28. The system of claim 21,wherein the reaction component generates verbal and visual feedback fromthe instructor avatar identifying the first user and the second user andcomparing the aspect of the performance of the group fitness routine bythe first user relative to a second aspect of the performance of thegroup fitness routine to the second user.
 29. The system of claim 21,wherein the reaction component generates verbal and visual feedback fromthe instructor avatar directed to the first user regarding the aspect ofthe performance of the group fitness routine by the first user.
 31. Thesystem of claim 21, wherein the reaction component generates verbal andvisual feedback from the instructor avatar directed to the second userregarding the aspect of the performance of the group fitness routine bythe first user.
 32. A method, comprising: generating, by a systemcomprising a processer, an instructor avatar corresponding to a groupfitness instructor that is configured to facilitate performance of agroup fitness routine by two or more users; presenting, by the system,the instructor avatar to the two or more users during the performance ofthe group fitness routine; receiving, by the system, first physiologicalfeedback from a first user of the two or more users during theperformance of the group fitness routine; receiving, by the system,second physiological feedback from a second user of the two or moreusers during the performance of the group fitness routine; evaluating,by the system, performance of the group fitness routine by the firstuser based on comparison of the first physiological feedback and thesecond physiological feedback; generating, by the system, a reaction formanifestation by the instructor avatar, regarding an aspect of theperformance of the group fitness routine by the first user based on thecomparison.
 33. The method of claim 32, further comprising: determining,by the system, whether the first user should maintain or modify theaspect of the performance of the group fitness routine by the first userbased on the comparing, wherein the reaction comprises an instruction tobe spoken or performed by the avatar regarding whether the first usershould maintain or modify the aspect of the performance of the groupfitness routine.
 33. The method of claim 32, further comprising:presenting, by the system, the instructor avatar in a graphical userinterface that also includes a first user avatar that corresponds to thefirst user and a second user avatar that corresponds to the second user.34. The method of claim 32, wherein the evaluating comprises determiningthat the aspect of the performance of the first user is better than acorresponding aspect of the performance of the fitness routine performedby the second user.
 35. The method of claim 32, wherein the reactioncomprises generating feedback identifying the first user and the seconduser and comparing the aspect of the performance of the group fitnessroutine by the first user relative to a second aspect of the performanceof the group fitness routine to the second user.
 36. The method of claim32, wherein the reaction comprises generating verbal and visual feedbackdirected to the second user regarding the aspect of the performance ofthe group fitness routine by the first user.
 37. The method of claim 32,wherein the determining the reaction comprises determining feedback thatcalls attention to the aspect of the performance of the fitness routineby the first user based on it being better than the corresponding aspectof the performance of the fitness routine performed by the second user.38. The method of claim 32, wherein the determining the reactioncomprises determining feedback that calls attention to the performanceof the fitness routine by the first user being superior to theperformance of the fitness routine by the second user.
 39. The system ofclaim 32, wherein the determining the reaction comprises determiningfeedback directed to the second user that encourages the second user toadjust the performance of the fitness routine by the second user to bemore like the performance of the fitness routine by the first user. 40.A non-transitory machine-readable storage medium comprising executableinstructions that, when executed by a processor, facilitate performanceof operations, comprising: generating an instructor avatar correspondingto a group fitness instructor that is configured to facilitateperformance of a group fitness routine by two or more users; presentingthe instructor avatar to the two or more users during the performance ofthe group fitness routine by the two or more users; receiving firstsensory feedback from a first user of the two or more users during theperformance of the group fitness routine, wherein the first sensoryfeedback comprises first physiological or motion data; receiving secondsensory feedback from a second user of the two or more users during theperformance of the fitness routine, wherein the second sensory feedbackcomprises second physiological or motion data; evaluating performance ofthe group fitness routine by the first user based on comparison of thefirst sensory feedback and the second sensory feedback; determining areaction, for manifestation by the instructor avatar, regarding anaspect of the performance of the group fitness routine by the first userbased on the comparison; and causing the instructor avatar to performthe reaction as presented to the two or more users during theperformance of the group fitness routine by the two or more users.